Apr 29 16:38:33 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:38:33 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:38:33 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:38:34 devstack cinder-volume[75486]: INFO dbcounter [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Registered counter for database cinder Apr 29 16:38:34 devstack cinder-volume[75486]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:38:34 devstack cinder-volume[75486]: DEBUG dbcounter [-] [75486] Writer thread running {{(pid=75486) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:38:34 devstack cinder-volume[75486]: INFO cinder.rpc [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 16:38:34 devstack cinder-volume[75486]: INFO cinder.rpc [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 16:38:34 devstack cinder-volume[75486]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:38:35 devstack cinder-volume[75486]: INFO cinder.volume.manager [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Determined volume DB was empty at startup. Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG cinder.volume.manager [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75486) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 16:38:35 devstack cinder-volume[75486]: INFO cinder.volume.manager [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 16:38:35 devstack cinder-volume[75486]: WARNING stevedore.named [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 16:38:35 devstack cinder-volume[75486]: WARNING castellan.key_manager [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:38:35 devstack cinder-volume[75486]: WARNING cinder.keymgr.conf_key_mgr [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG cinder.volume.drivers.lvm [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75486) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_concurrency.processutils [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_concurrency.processutils [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.491s {{(pid=75486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:38:35 devstack cinder-volume[75486]: INFO cinder.rpc [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 16:38:35 devstack cinder-volume[75486]: INFO cinder.rpc [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 16:38:35 devstack cinder-volume[75486]: WARNING stevedore.named [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 16:38:35 devstack cinder-volume[75486]: WARNING castellan.key_manager [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:38:35 devstack cinder-volume[75486]: INFO cinder.volume.manager [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:38:35 devstack cinder-volume[75486]: INFO oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Starting 1 workers Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Started child 75705 {{(pid=75486) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Full set of CONF: {{(pid=75486) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] ******************************************************************************** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Configuration options gathered from: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] ================================================================================ {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] allow_availability_zone_fallback = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] allow_compression_on_image_upload = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] allowed_direct_url_schemes = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] api_rate_limit = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] auth_strategy = keystone {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] az_cache_duration = 3600 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_availability_zone = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_host = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75705]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_stats_polling_interval = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backup_api_class = cinder.backup.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backup_name_template = backup-%s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backup_use_same_host = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backup_use_temp_snapshot = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] chap_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] chap_username = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cinder_internal_tenant_project_id = 13f335c12785462fa54f9006dcca5c32 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cinder_internal_tenant_user_id = 187d6a71039f4b309c88bab670c55ce3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cloned_volume_same_az = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cluster = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] compression_format = gzip {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] compute_api_class = cinder.compute.nova.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] config_dir = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] config_source = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] control_exchange = openstack {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] debug = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] default_availability_zone = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] default_group_type = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] default_volume_type = lvmdriver-1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] disk_geometry = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] driver_client_cert = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] driver_client_cert_key = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] driver_data_namespace = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] driver_ssl_cert_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] driver_ssl_cert_verify = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] driver_use_ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] enable_force_upload = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] enable_new_services = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] enable_unsupported_driver = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] enforce_multipath_for_image_xfer = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] filter_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_api_insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_api_ssl_compression = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_ca_certificates_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_catalog_info = image:glance:publicURL {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_num_retries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance_request_timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] goodness_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] graceful_shutdown_timeout = 5 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] group_api_class = cinder.group.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] host = devstack {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_compress_on_upload = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_conversion_address_space_limit = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_conversion_cpu_limit = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_conversion_disable = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_upload_use_cinder_backend = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_upload_use_internal_tenant = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_volume_cache_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_volume_cache_max_count = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] image_volume_cache_max_size_gb = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] init_host_max_objects_retrieval = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] instance_format = [instance: %(uuid)s] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] iscsi_target_flags = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] iscsi_write_cache = on {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] iser_helper = tgtadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] iser_ip_address = 192.168.122.67 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] iser_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] log_color = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] log_config_append = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] log_dir = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] log_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] log_options = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] log_rotate_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] log_rotate_interval_type = days {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] log_rotation_type = none {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] max_age = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] max_logfile_count = 30 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] max_logfile_size_mb = 200 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] max_over_subscription_ratio = 20.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] message_reap_interval = 86400 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] message_ttl = 2592000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] migration_create_volume_timeout_secs = 300 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] monkey_patch = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] monkey_patch_modules = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] my_ip = 192.168.122.67 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75705]: INFO cinder.volume.manager [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] no_snapshot_gb_quota = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] num_iser_scan_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] num_shell_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] num_volume_device_scan_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] nvmeof_conn_info_version = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] nvmet_ns_id = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] nvmet_port_id = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] osapi_max_limit = 1000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] osapi_volume_ext_list = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] osapi_volume_listen_port = 8776 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] osapi_volume_use_ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] osapi_volume_workers = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] per_volume_size_limit = -1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] periodic_fuzzy_delay = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] periodic_interval = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] public_endpoint = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] publish_errors = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] quota_backup_gigabytes = 1000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] quota_backups = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] quota_gigabytes = 1000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] quota_groups = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] quota_snapshots = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] quota_volumes = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] rate_limit_burst = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] rate_limit_except_level = CRITICAL {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] rate_limit_interval = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] reinit_driver_count = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] replication_device = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] report_discard_supported = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] report_interval = 120 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] reservation_clean_interval = 86400 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] reservation_expire = 86400 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] reserved_image_namespaces = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] reserved_percentage = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] rpc_response_timeout = 120 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] run_external_periodic_tasks = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] scst_target_driver = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] scst_target_iqn_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_down_time = 720 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] shell_completion = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] snapshot_name_template = snapshot-%s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] snapshot_same_host = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] state_path = /opt/stack/data/cinder {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] storage_availability_zone = nova {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] storage_protocol = iSCSI {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] syslog_log_facility = LOG_USER {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] target_helper = lioadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] target_ip_address = 192.168.122.67 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] target_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] target_protocol = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] target_secondary_ip_addresses = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] trace_flags = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack sudo[75749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] transport_url = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] until_refresh = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] use_chap_auth = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] use_default_quota_class = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] use_journal = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] use_json = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack sudo[75749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] use_multipath_for_image_xfer = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] use_stderr = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] use_syslog = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] verify_glance_signatures = enabled {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_api_class = cinder.volume.api.API {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_backend_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_clear = zero {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_clear_ionice = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_clear_size = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_copy_bps_limit = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_dd_blocksize = 1M {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_name_template = volume-%s {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_service_inithost_offload = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volume_usage_audit_period = month {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] zoning_mode = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_concurrency.disable_process_locking = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.admin_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.admin_token = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.admin_user = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.auth_port = 35357 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.auth_protocol = https {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.auth_section = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.auth_type = password {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.auth_uri = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.auth_version = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.cache = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.identity_uri = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.include_service_catalog = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.interface = public {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_password = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcache_username = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.region_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.service_type = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.67/identity {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.backend = dogpile.cache.null {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.backend_argument = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.backend_expiration_time = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.config_prefix = cache.oslo {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.debug_cache_backend = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.enable_retry_client = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.enable_socket_keepalive = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.enforce_fips_mode = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.expiration_time = 600 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.hashclient_retry_attempts = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.memcache_dead_retry = 300 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.memcache_pool_maxsize = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.memcache_sasl_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.proxies = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.redis_db = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.redis_server = localhost:6379 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.retry_attempts = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.retry_delay = 0.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.socket_keepalive_count = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.socket_keepalive_idle = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.socket_keepalive_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.socket_timeout = 1.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.tls_allowed_ciphers = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.tls_cafile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.tls_certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.tls_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.tls_keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cache.username = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] coordination.backend_url = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.asyncio_connection = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.asyncio_slave_connection = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.backend = sqlalchemy {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.connection = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.connection_debug = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.connection_parameters = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.connection_recycle_time = 3600 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.connection_trace = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.db_inc_retry_interval = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.db_max_retries = 20 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.db_max_retry_interval = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.db_retry_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.max_overflow = 50 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.max_pool_size = 5 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.max_retries = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.mysql_wsrep_sync_wait = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.pool_timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.retry_interval = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.slave_connection = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.sqlite_synchronous = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.synchronous_reader = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] database.use_db_reconnect = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.connection_string = messaging:// {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.es_doc_type = notification {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.es_scroll_size = 10000 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.es_scroll_time = 2m {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.filter_error_trace = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.hmac_keys = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.sentinel_service_name = mymaster {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.socket_timeout = 0.1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.trace_requests = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler.trace_sqlalchemy = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler_jaeger.process_tags = {} {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler_jaeger.service_name_prefix = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] profiler_otlp.service_name_prefix = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.enforce_new_defaults = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: WARNING oslo_config.cfg [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.enforce_scope = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.policy_default_rule = default {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.policy_file = policy.yaml {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] privsep_osbrick.group = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] privsep_osbrick.helper_command = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] privsep_osbrick.user = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cinder_sys_admin.group = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cinder_sys_admin.helper_command = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] cinder_sys_admin.user = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.auth_section = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.auth_type = password {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.cafile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.collect_timing = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.send_service_user_token = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] service_user.timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.auth_section = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.auth_type = password {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.collect_timing = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.region_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] glance.timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.backend_availability_zone = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.chap_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.chap_username = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.disk_geometry = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.driver_client_cert = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.driver_client_cert_key = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.driver_data_namespace = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:35 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.driver_use_ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.extra_capabilities = {} {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.filter_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.goodness_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.iscsi_target_flags = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.iscsi_write_cache = on {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.iser_helper = tgtadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.iser_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.lvm_share_target = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.lvm_type = auto {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.num_shell_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.replication_device = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.report_discard_supported = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.reserved_percentage = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.target_helper = tgtadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.target_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.target_protocol = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.trace_flags = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.unique_fqdn_network = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.use_chap_auth = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volume_backend_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volume_clear = zero {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volume_clear_ionice = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volume_clear_size = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_reports.file_event_handler = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_reports.log_dir = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.backend_host = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.chap_password = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.chap_username = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.disk_geometry = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.driver_client_cert = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.extra_capabilities = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.filter_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.goodness_function = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.iser_helper = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.iser_ip_address = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.iser_port = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.lvm_share_target = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.lvm_type = auto {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.num_shell_tries = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.replication_device = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.report_discard_supported = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.reserved_percentage = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.scst_target_driver = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.storage_protocol = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.target_helper = lioadm {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.target_ip_address = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.target_port = 3260 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.trace_flags = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.use_chap_auth = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volume_clear = zero {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volume_clear_size = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] lvmdriver-1.volumes_dir = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_notifications.driver = [] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_notifications.retry = -1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] key_manager.fixed_key = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.barbican_api_version = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.barbican_endpoint = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.barbican_endpoint_type = public {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.barbican_region_name = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.cafile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.collect_timing = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.number_of_retries = 60 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.retry_delay = 1 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.send_service_user_token = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.verify_ssl = True {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican.verify_ssl_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican_service_user.auth_section = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican_service_user.auth_type = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican_service_user.cafile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican_service_user.certfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican_service_user.collect_timing = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican_service_user.insecure = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican_service_user.keyfile = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican_service_user.split_loggers = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] barbican_service_user.timeout = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.approle_role_id = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.approle_secret_id = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.kv_mountpoint = secret {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.kv_path = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.kv_version = 2 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.namespace = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.root_token_id = **** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.ssl_ca_crt_file = None {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.timeout = 60.0 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.use_ssl = False {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:38:36 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] ******************************************************************************** {{(pid=75486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 16:38:36 devstack sudo[75749]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:36 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:36 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:36 devstack sudo[75996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:38:36 devstack sudo[75996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:37 devstack sudo[75996]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:37 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.655s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:37 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:38:37 devstack cinder-volume[75705]: INFO cinder.brick.local_dev.lvm [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 16:38:37 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:37 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:37 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:37 devstack sudo[76177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:38:37 devstack sudo[76177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:38 devstack sudo[76177]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:38 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.725s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:38 devstack cinder-volume[75705]: DEBUG cinder.brick.local_dev.lvm [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75705) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 16:38:38 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:38 devstack sudo[76334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:38:38 devstack sudo[76334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:39 devstack sudo[76334]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:39 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.126s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:39 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:39 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:39 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:39 devstack sudo[76459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:38:39 devstack sudo[76459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:39 devstack sudo[76459]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:39 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.768s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:39 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:39 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:39 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:39 devstack sudo[76470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 16:38:40 devstack sudo[76470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:40 devstack sudo[76470]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:40 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.645s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:40 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:40 devstack sudo[76474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:38:40 devstack sudo[76474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:41 devstack sudo[76474]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:41 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:41 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:41 devstack sudo[76478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:38:41 devstack sudo[76478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:41 devstack sudo[76478]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:41 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:41 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:41 devstack sudo[76482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:38:41 devstack sudo[76482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:42 devstack sudo[76482]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:42 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:42 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:42 devstack sudo[76489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:38:42 devstack sudo[76489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:43 devstack sudo[76489]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:43 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.773s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:43 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:43 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:43 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:43 devstack sudo[76495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:38:43 devstack sudo[76495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:44 devstack sudo[76495]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:44 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:44 devstack cinder-volume[75705]: INFO cinder.volume.drivers.lvm [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 16:38:44 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:44 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:44 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:44 devstack sudo[76544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:38:44 devstack sudo[76544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:44 devstack sudo[76544]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:44 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.830s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:44 devstack cinder-volume[75705]: DEBUG cinder.volume.drivers.lvm [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Updating volume stats {{(pid=75705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:38:44 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:45 devstack sudo[76705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:38:45 devstack sudo[76705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:45 devstack sudo[76705]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:45 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:45 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:45 devstack sudo[76757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:38:45 devstack sudo[76757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:45 devstack cinder-volume[75486]: DEBUG dbcounter [-] [75486] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75486) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:38:46 devstack sudo[76757]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:46 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:46 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:46 devstack sudo[76764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:38:46 devstack sudo[76764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:46 devstack sudo[76764]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:46 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:46 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:46 devstack sudo[76767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:38:46 devstack sudo[76767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:47 devstack sudo[76767]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:47 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:47 devstack cinder-volume[75705]: INFO cinder.volume.driver [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 16:38:47 devstack cinder-volume[75705]: DEBUG cinder.volume.driver [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75705) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 16:38:47 devstack cinder-volume[75705]: DEBUG oslo_db.sqlalchemy.engines [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75705) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:38:47 devstack cinder-volume[75705]: DEBUG dbcounter [-] [75705] Writer thread running {{(pid=75705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:38:47 devstack cinder-volume[75705]: DEBUG cinder.db.sqlalchemy.api [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Building query based on filter {{(pid=75705) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 16:38:47 devstack cinder-volume[75705]: DEBUG cinder.image.image_utils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75705) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 16:38:47 devstack cinder-volume[75705]: INFO cinder.keymgr.migration [None req-f111e2f2-ae46-4f8f-8f07-faf3f7ea0da9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 16:38:47 devstack cinder-volume[75705]: DEBUG cinder.volume.drivers.lvm [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Updating volume stats {{(pid=75705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:38:47 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:47 devstack sudo[76771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:38:47 devstack sudo[76771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:48 devstack sudo[76771]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:48 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:48 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:48 devstack sudo[76775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:38:48 devstack sudo[76775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:48 devstack sudo[76775]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:48 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:48 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:48 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:38:48 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:49 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:49 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.700s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:49 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:49 devstack sudo[76786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:38:49 devstack sudo[76786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:50 devstack sudo[76786]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:50 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:50 devstack cinder-volume[75705]: DEBUG cinder.manager [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Notifying Schedulers of capabilities ... {{(pid=75705) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:38:50 devstack cinder-volume[75705]: INFO cinder.volume.manager [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Driver initialization completed successfully. Apr 29 16:38:50 devstack cinder-volume[75705]: INFO cinder.manager [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Initiating service 2 cleanup Apr 29 16:38:50 devstack cinder-volume[75705]: INFO cinder.manager [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Service 2 cleanup completed. Apr 29 16:38:50 devstack cinder-volume[75705]: DEBUG cinder.service [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Creating RPC server for service cinder-volume {{(pid=75705) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 16:38:50 devstack cinder-volume[75705]: DEBUG cinder.service [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75705) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 16:38:50 devstack cinder-volume[75705]: INFO cinder.volume.manager [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 16:38:50 devstack cinder-volume[75705]: DEBUG cinder.volume.drivers.lvm [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Updating volume stats {{(pid=75705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:38:50 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:50 devstack sudo[76790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:38:50 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:50 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:50 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:50 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:50 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:38:50 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:51 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:51 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:51 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:51 devstack sudo[76850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:38:51 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:52 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:52 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.603s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:52 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:38:52 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:38:52 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:38:52 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Apr 29 16:38:52 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:38:52 devstack cinder-volume[75705]: INFO cinder.volume.manager [None req-7d9cc025-c30b-4fec-b632-481a7a37afd5 None None] Driver post RPC initialization completed successfully. Apr 29 16:39:02 devstack cinder-volume[75705]: DEBUG dbcounter [-] [75705] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:39:02 devstack cinder-volume[75705]: DEBUG dbcounter [-] [75705] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:40:21 devstack cinder-volume[75705]: DEBUG oslo_service.periodic_task [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:40:21 devstack cinder-volume[75705]: DEBUG cinder.volume.drivers.lvm [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Updating volume stats {{(pid=75705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:40:21 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:40:21 devstack sudo[81575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:40:21 devstack sudo[81575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:40:22 devstack sudo[81575]: pam_unix(sudo:session): session closed for user root Apr 29 16:40:22 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:40:22 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:40:22 devstack sudo[81578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:40:22 devstack sudo[81578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:40:23 devstack sudo[81578]: pam_unix(sudo:session): session closed for user root Apr 29 16:40:23 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:40:23 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:40:23 devstack sudo[81581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:40:23 devstack sudo[81581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:40:23 devstack sudo[81581]: pam_unix(sudo:session): session closed for user root Apr 29 16:40:23 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.591s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:40:23 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:40:23 devstack sudo[81584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:40:23 devstack sudo[81584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:40:24 devstack sudo[81584]: pam_unix(sudo:session): session closed for user root Apr 29 16:40:24 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:40:24 devstack cinder-volume[75705]: DEBUG cinder.manager [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Notifying Schedulers of capabilities ... {{(pid=75705) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:41:02 devstack cinder-volume[75705]: DEBUG dbcounter [-] [75705] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:41:21 devstack cinder-volume[75705]: DEBUG oslo_service.periodic_task [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:41:21 devstack cinder-volume[75705]: DEBUG cinder.volume.drivers.lvm [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Updating volume stats {{(pid=75705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:41:21 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:21 devstack sudo[82084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:41:21 devstack sudo[82084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:41:22 devstack sudo[82084]: pam_unix(sudo:session): session closed for user root Apr 29 16:41:22 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:22 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:22 devstack sudo[82087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:41:22 devstack sudo[82087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:41:23 devstack sudo[82087]: pam_unix(sudo:session): session closed for user root Apr 29 16:41:23 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:23 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:23 devstack sudo[82090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:41:23 devstack sudo[82090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:41:23 devstack sudo[82090]: pam_unix(sudo:session): session closed for user root Apr 29 16:41:23 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.604s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:23 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:23 devstack sudo[82093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:41:23 devstack sudo[82093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:41:24 devstack sudo[82093]: pam_unix(sudo:session): session closed for user root Apr 29 16:41:24 devstack cinder-volume[75705]: DEBUG oslo_concurrency.processutils [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:24 devstack cinder-volume[75705]: DEBUG cinder.manager [None req-fa2d5a62-798f-438f-bac6-99d603706598 None None] Notifying Schedulers of capabilities ... {{(pid=75705) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:41:38 devstack cinder-volume[75486]: INFO oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Caught SIGTERM, stopping children Apr 29 16:41:38 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Acquiring lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:41:38 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Acquired lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:41:38 devstack cinder-volume[75486]: DEBUG oslo_concurrency.lockutils [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Releasing lock "singleton_lock" {{(pid=75486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:41:38 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Stop services. {{(pid=75486) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 16:41:38 devstack cinder-volume[75486]: DEBUG oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Killing children. {{(pid=75486) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 16:41:38 devstack cinder-volume[75486]: INFO oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Waiting on 1 children to exit Apr 29 16:41:40 devstack cinder-volume[75705]: DEBUG oslo_concurrency.lockutils [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Acquiring lock "singleton_lock" {{(pid=75705) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:41:40 devstack cinder-volume[75705]: DEBUG oslo_concurrency.lockutils [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Acquired lock "singleton_lock" {{(pid=75705) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:41:40 devstack cinder-volume[75705]: DEBUG oslo_concurrency.lockutils [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Releasing lock "singleton_lock" {{(pid=75705) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:41:40 devstack cinder-volume[75705]: WARNING amqp [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 16:41:40 devstack cinder-volume[75705]: WARNING amqp [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 16:41:40 devstack cinder-volume[75486]: INFO oslo_service.backend._eventlet.service [None req-3e4e5327-1984-4b77-b957-dfe88540a7f6 None None] Child 75705 exited with status 0 Apr 29 16:41:42 devstack cinder-volume[83330]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:41:42 devstack cinder-volume[83330]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:41:42 devstack cinder-volume[83330]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:41:43 devstack cinder-volume[83330]: INFO dbcounter [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Registered counter for database cinder Apr 29 16:41:43 devstack cinder-volume[83330]: DEBUG oslo_db.sqlalchemy.engines [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:41:43 devstack cinder-volume[83330]: DEBUG dbcounter [-] [83330] Writer thread running {{(pid=83330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:41:43 devstack cinder-volume[83330]: INFO cinder.rpc [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 16:41:43 devstack cinder-volume[83330]: INFO cinder.rpc [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 16:41:43 devstack cinder-volume[83330]: DEBUG oslo_db.sqlalchemy.engines [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:41:43 devstack cinder-volume[83330]: INFO cinder.volume.manager [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Determined volume DB was empty at startup. Apr 29 16:41:43 devstack cinder-volume[83330]: DEBUG cinder.volume.manager [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83330) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 16:41:43 devstack cinder-volume[83330]: INFO cinder.volume.manager [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 16:41:43 devstack cinder-volume[83330]: WARNING stevedore.named [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 16:41:43 devstack cinder-volume[83330]: WARNING castellan.key_manager [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:41:43 devstack cinder-volume[83330]: WARNING cinder.keymgr.conf_key_mgr [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:41:43 devstack cinder-volume[83330]: INFO cinder.volume.manager [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 16:41:43 devstack cinder-volume[83330]: DEBUG oslo_db.sqlalchemy.engines [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:41:44 devstack cinder-volume[83330]: INFO oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Starting 1 workers Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Started child 83534 {{(pid=83330) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Full set of CONF: {{(pid=83330) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] ******************************************************************************** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Configuration options gathered from: {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] ================================================================================ {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 16:41:44 devstack cinder-volume[83534]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] allow_availability_zone_fallback = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] allow_compression_on_image_upload = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] allowed_direct_url_schemes = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] api_rate_limit = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] auth_strategy = keystone {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_availability_zone = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_host = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_stats_polling_interval = 60 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backup_api_class = cinder.backup.api.API {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backup_name_template = backup-%s {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backup_use_same_host = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backup_use_temp_snapshot = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] chap_password = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] chap_username = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cinder_internal_tenant_project_id = 13f335c12785462fa54f9006dcca5c32 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cinder_internal_tenant_user_id = 187d6a71039f4b309c88bab670c55ce3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cluster = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] compression_format = gzip {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] compute_api_class = cinder.compute.nova.API {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] config_dir = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] config_source = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] control_exchange = openstack {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] debug = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] default_availability_zone = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] default_group_type = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] default_volume_type = QuobyteHD {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] disk_geometry = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] driver_client_cert = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] driver_client_cert_key = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] driver_data_namespace = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] driver_ssl_cert_path = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] driver_ssl_cert_verify = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] driver_use_ssl = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] enable_new_services = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] enable_unsupported_driver = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] enabled_backends = ['QuobyteHD'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] enforce_multipath_for_image_xfer = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] filter_function = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_api_insecure = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_api_ssl_compression = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_ca_certificates_file = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_catalog_info = image:glance:publicURL {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_certfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_keyfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_num_retries = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance_request_timeout = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] goodness_function = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] graceful_shutdown_timeout = 5 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] group_api_class = cinder.group.api.API {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] host = devstack {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_compress_on_upload = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_conversion_address_space_limit = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_conversion_cpu_limit = 60 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_conversion_disable = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_upload_use_cinder_backend = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_upload_use_internal_tenant = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_volume_cache_enabled = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_volume_cache_max_count = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83534]: INFO cinder.volume.manager [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 16:41:44 devstack cinder-volume[83534]: DEBUG cinder.volume.drivers.remotefs [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83534) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] image_volume_cache_max_size_gb = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] init_host_max_objects_retrieval = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] instance_format = [instance: %(uuid)s] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] iscsi_target_flags = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] iscsi_write_cache = on {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] iser_helper = tgtadm {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] iser_ip_address = 192.168.122.67 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] iser_port = 3260 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] log_color = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] log_config_append = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] log_dir = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] log_file = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] log_options = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] log_rotate_interval = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] log_rotate_interval_type = days {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] log_rotation_type = none {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] max_age = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] max_logfile_count = 30 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] max_logfile_size_mb = 200 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] max_over_subscription_ratio = 20.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] message_reap_interval = 86400 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] message_ttl = 2592000 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] migration_create_volume_timeout_secs = 300 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] monkey_patch = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] monkey_patch_modules = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] my_ip = 192.168.122.67 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] no_snapshot_gb_quota = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] num_iser_scan_tries = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] num_shell_tries = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] num_volume_device_scan_tries = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] nvmeof_conn_info_version = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] nvmet_ns_id = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] nvmet_port_id = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] osapi_max_limit = 1000 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] osapi_volume_ext_list = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] osapi_volume_listen_port = 8776 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] osapi_volume_use_ssl = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] osapi_volume_workers = 2 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] per_volume_size_limit = -1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] periodic_fuzzy_delay = 60 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] periodic_interval = 60 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] public_endpoint = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] publish_errors = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] quota_backup_gigabytes = 1000 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] quota_backups = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] quota_gigabytes = 1000 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] quota_groups = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] quota_snapshots = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] quota_volumes = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] rate_limit_burst = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] rate_limit_except_level = CRITICAL {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] rate_limit_interval = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] reinit_driver_count = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] replication_device = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] report_discard_supported = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] report_interval = 120 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] reservation_clean_interval = 86400 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] reservation_expire = 86400 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] reserved_image_namespaces = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] reserved_percentage = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] rpc_response_timeout = 120 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] run_external_periodic_tasks = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] scst_target_driver = iscsi {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] scst_target_iqn_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_down_time = 720 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] shell_completion = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] snapshot_name_template = snapshot-%s {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] split_loggers = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] state_path = /opt/stack/data/cinder {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] storage_availability_zone = nova {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] storage_protocol = iSCSI {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] syslog_log_facility = LOG_USER {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] target_helper = lioadm {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] target_ip_address = 192.168.122.67 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] target_port = 3260 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] target_protocol = iscsi {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] target_secondary_ip_addresses = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] trace_flags = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] transport_url = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] until_refresh = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] use_chap_auth = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] use_default_quota_class = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] use_journal = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] use_json = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] use_multipath_for_image_xfer = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] use_stderr = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] use_syslog = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] verify_glance_signatures = enabled {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_api_class = cinder.volume.api.API {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_backend_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_clear = zero {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_clear_ionice = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_clear_size = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_copy_bps_limit = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_dd_blocksize = 1M {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_name_template = volume-%s {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_service_inithost_offload = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volume_usage_audit_period = month {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] zoning_mode = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_concurrency.disable_process_locking = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.admin_password = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.admin_token = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.admin_user = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.auth_port = 35357 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.auth_protocol = https {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.auth_section = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.auth_type = password {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.auth_uri = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.auth_version = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.cache = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.certfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.identity_uri = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.include_service_catalog = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.insecure = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.interface = public {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.keyfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_password = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcache_username = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.region_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.service_type = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.67/identity {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.backend = dogpile.cache.null {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.backend_argument = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.backend_expiration_time = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.config_prefix = cache.oslo {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.debug_cache_backend = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.enable_retry_client = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.enable_socket_keepalive = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.enabled = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.enforce_fips_mode = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.expiration_time = 600 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83534]: DEBUG cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83534) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 16:41:44 devstack cinder-volume[83534]: WARNING cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 16:41:44 devstack cinder-volume[83534]: WARNING cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.hashclient_retry_attempts = 2 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.memcache_dead_retry = 300 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.memcache_pool_maxsize = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.memcache_sasl_enabled = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.password = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Running cmd (subprocess): mount.quobyte {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.proxies = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.redis_db = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.redis_server = localhost:6379 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.retry_attempts = 2 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.retry_delay = 0.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.socket_keepalive_count = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.socket_keepalive_idle = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.socket_keepalive_interval = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.socket_timeout = 1.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.tls_allowed_ciphers = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.tls_cafile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.tls_certfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.tls_enabled = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.tls_keyfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cache.username = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] coordination.backend_url = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.asyncio_connection = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.asyncio_slave_connection = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.backend = sqlalchemy {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.connection = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.connection_debug = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.connection_parameters = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.connection_recycle_time = 3600 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.connection_trace = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.db_inc_retry_interval = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.db_max_retries = 20 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.db_max_retry_interval = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.db_retry_interval = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.max_overflow = 50 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.max_pool_size = 5 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.max_retries = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.mysql_wsrep_sync_wait = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.pool_timeout = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.retry_interval = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.slave_connection = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.sqlite_synchronous = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.synchronous_reader = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] database.use_db_reconnect = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.connection_string = messaging:// {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.enabled = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.es_doc_type = notification {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.es_scroll_size = 10000 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.es_scroll_time = 2m {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.filter_error_trace = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.hmac_keys = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.sentinel_service_name = mymaster {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.socket_timeout = 0.1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.trace_requests = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler.trace_sqlalchemy = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler_jaeger.process_tags = {} {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler_jaeger.service_name_prefix = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] profiler_otlp.service_name_prefix = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.enforce_new_defaults = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: WARNING oslo_config.cfg [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.enforce_scope = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.policy_default_rule = default {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.policy_file = policy.yaml {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] privsep_osbrick.group = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] privsep_osbrick.helper_command = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] privsep_osbrick.user = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cinder_sys_admin.group = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cinder_sys_admin.helper_command = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] cinder_sys_admin.user = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.auth_section = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.auth_type = password {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.cafile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.certfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.collect_timing = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.insecure = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.keyfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.send_service_user_token = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.split_loggers = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] service_user.timeout = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.auth_section = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.auth_type = password {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.certfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.collect_timing = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.insecure = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.keyfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.region_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.split_loggers = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] glance.timeout = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.backend_availability_zone = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.chap_password = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.chap_username = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.disk_geometry = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.driver_client_cert = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.driver_client_cert_key = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.driver_data_namespace = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.driver_use_ssl = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.extra_capabilities = {} {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.filter_function = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.goodness_function = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.iscsi_target_flags = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.iscsi_write_cache = on {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.iser_helper = tgtadm {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.iser_port = 3260 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_host = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_login = admin {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_mount_options = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_password = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_private_key = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_share_path = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.num_shell_tries = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.quobyte_volume_url = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.replication_device = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.report_discard_supported = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.reserved_percentage = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.target_helper = tgtadm {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.target_port = 3260 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.target_protocol = iscsi {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.trace_flags = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.unique_fqdn_network = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.use_chap_auth = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.volume_backend_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.volume_clear = zero {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.volume_clear_ionice = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.volume_clear_size = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_reports.file_event_handler = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_reports.log_dir = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.backend_availability_zone = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.backend_host = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.chap_password = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.chap_username = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.chiscsi_conf = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.disk_geometry = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.driver_client_cert = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.driver_data_namespace = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.driver_use_ssl = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.extra_capabilities = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.filter_function = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.goodness_function = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.iser_helper = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.iser_ip_address = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.iser_port = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.iser_target_prefix = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_host = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_login = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_mount_options = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_password = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_private_key = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_share_path = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_ssh_port = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.num_shell_tries = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.nvmet_port_id = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack quobyte-client[83616]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 16:41:44 devstack quobyte-client[83616]: Invalid parameters found, error: missing mount point. Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.replication_device = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.report_discard_supported = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.reserved_percentage = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack quobyte-client[83616]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.scst_target_driver = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.storage_protocol = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.target_helper = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack quobyte-client[83616]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.target_ip_address = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.target_port = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] CMD "mount.quobyte" returned: 1 in 0.159s {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.target_prefix = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.target_protocol = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.trace_flags = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.use_chap_auth = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:41:44 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:41:44 devstack cinder-volume[83534]: DEBUG cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=83534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.volume_clear = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.volume_clear_size = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83534]: INFO cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 ... Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab -c /etc/quobyte/client-cinder.cfg {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] QuobyteHD.volumes_dir = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.ssl = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_notifications.driver = [] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_notifications.retry = -1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] key_manager.fixed_key = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.barbican_api_version = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.barbican_endpoint = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.barbican_endpoint_type = public {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.barbican_region_name = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.cafile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.certfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.collect_timing = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.insecure = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.keyfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.number_of_retries = 60 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.retry_delay = 1 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.send_service_user_token = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.split_loggers = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.timeout = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.verify_ssl = True {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican.verify_ssl_path = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican_service_user.auth_section = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican_service_user.auth_type = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican_service_user.cafile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican_service_user.certfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican_service_user.collect_timing = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican_service_user.insecure = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican_service_user.keyfile = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican_service_user.split_loggers = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] barbican_service_user.timeout = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.approle_role_id = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.approle_secret_id = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.kv_mountpoint = secret {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.kv_path = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.kv_version = 2 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.namespace = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.root_token_id = **** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.ssl_ca_crt_file = None {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.timeout = 60.0 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.use_ssl = False {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:44 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] ******************************************************************************** {{(pid=83330) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 16:41:44 devstack sudo[83627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab -c /etc/quobyte/client-cinder.cfg Apr 29 16:41:44 devstack sudo[83627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:41:45 devstack sudo[83627]: pam_unix(sudo:session): session closed for user root Apr 29 16:41:45 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.782s {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:45 devstack cinder-volume[83534]: INFO cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 succeeded Apr 29 16:41:45 devstack cinder-volume[83534]: DEBUG cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=83534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:41:45 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.800s {{(pid=83534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:41:45 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:45 devstack sudo[83711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:41:45 devstack sudo[83711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:41:45 devstack sudo[83711]: pam_unix(sudo:session): session closed for user root Apr 29 16:41:45 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.599s {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:45 devstack cinder-volume[83534]: INFO cinder.volume.driver [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 16:41:45 devstack cinder-volume[83534]: DEBUG cinder.volume.driver [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5835723876953, 'free_capacity_gb': 1775.5835723876953, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83534) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 16:41:45 devstack cinder-volume[83534]: DEBUG oslo_db.sqlalchemy.engines [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:41:45 devstack cinder-volume[83534]: DEBUG dbcounter [-] [83534] Writer thread running {{(pid=83534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:41:45 devstack cinder-volume[83534]: DEBUG cinder.db.sqlalchemy.api [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Building query based on filter {{(pid=83534) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG cinder.image.image_utils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83534) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 16:41:46 devstack cinder-volume[83534]: INFO cinder.keymgr.migration [None req-ddae6742-24b2-4630-a920-3ad353d74163 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=83534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=83534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:46 devstack sudo[83740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:41:46 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:41:46 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.608s {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG cinder.manager [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Notifying Schedulers of capabilities ... {{(pid=83534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:41:46 devstack cinder-volume[83534]: INFO cinder.volume.manager [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Driver initialization completed successfully. Apr 29 16:41:46 devstack cinder-volume[83534]: INFO cinder.manager [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Initiating service 3 cleanup Apr 29 16:41:46 devstack cinder-volume[83534]: INFO cinder.manager [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Service 3 cleanup completed. Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG cinder.service [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Creating RPC server for service cinder-volume {{(pid=83534) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG cinder.service [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83534) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 16:41:46 devstack cinder-volume[83534]: INFO cinder.volume.manager [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=83534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG cinder.volume.drivers.quobyte [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=83534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:41:46 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:46 devstack sudo[83757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:41:46 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:41:47 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root Apr 29 16:41:47 devstack cinder-volume[83534]: DEBUG oslo_concurrency.processutils [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.644s {{(pid=83534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:47 devstack cinder-volume[83534]: INFO cinder.volume.manager [None req-5439a926-f4bd-4bd1-a92b-850c5c5d28a0 None None] Driver post RPC initialization completed successfully. Apr 29 16:41:51 devstack cinder-volume[83330]: INFO oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Caught SIGTERM, stopping children Apr 29 16:41:51 devstack cinder-volume[83330]: DEBUG oslo_concurrency.lockutils [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Acquiring lock "singleton_lock" {{(pid=83330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:41:51 devstack cinder-volume[83330]: DEBUG oslo_concurrency.lockutils [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Acquired lock "singleton_lock" {{(pid=83330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:41:51 devstack cinder-volume[83330]: DEBUG oslo_concurrency.lockutils [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Releasing lock "singleton_lock" {{(pid=83330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:41:51 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Stop services. {{(pid=83330) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 16:41:51 devstack cinder-volume[83330]: DEBUG oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Killing children. {{(pid=83330) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 16:41:51 devstack cinder-volume[83330]: INFO oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Waiting on 1 children to exit Apr 29 16:41:55 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Acquiring lock "singleton_lock" {{(pid=83534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:41:55 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Acquired lock "singleton_lock" {{(pid=83534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:41:55 devstack cinder-volume[83534]: DEBUG oslo_concurrency.lockutils [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Releasing lock "singleton_lock" {{(pid=83534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:41:55 devstack cinder-volume[83534]: WARNING amqp [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 16:41:55 devstack cinder-volume[83534]: WARNING amqp [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 16:41:55 devstack cinder-volume[83330]: INFO oslo_service.backend._eventlet.service [None req-111ce287-b27c-4d6d-83a0-9bab2d562804 None None] Child 83534 exited with status 0 Apr 29 16:41:58 devstack cinder-volume[83942]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:41:58 devstack cinder-volume[83942]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:41:58 devstack cinder-volume[83942]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:41:59 devstack cinder-volume[83942]: INFO dbcounter [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Registered counter for database cinder Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_db.sqlalchemy.engines [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83942) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG dbcounter [-] [83942] Writer thread running {{(pid=83942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:41:59 devstack cinder-volume[83942]: INFO cinder.rpc [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 16:41:59 devstack cinder-volume[83942]: INFO cinder.rpc [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_db.sqlalchemy.engines [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83942) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:41:59 devstack cinder-volume[83942]: INFO cinder.volume.manager [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Determined volume DB was empty at startup. Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG cinder.volume.manager [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83942) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 16:41:59 devstack cinder-volume[83942]: WARNING stevedore.named [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 16:41:59 devstack cinder-volume[83942]: WARNING castellan.key_manager [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:41:59 devstack cinder-volume[83942]: WARNING cinder.keymgr.conf_key_mgr [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:41:59 devstack cinder-volume[83942]: INFO cinder.volume.manager [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_db.sqlalchemy.engines [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83942) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:41:59 devstack cinder-volume[83942]: INFO oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Starting 1 workers Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Started child 84201 {{(pid=83942) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Full set of CONF: {{(pid=83942) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] ******************************************************************************** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Configuration options gathered from: {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] ================================================================================ {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 16:41:59 devstack cinder-volume[84201]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] allow_availability_zone_fallback = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] allow_compression_on_image_upload = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] allowed_direct_url_schemes = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] api_rate_limit = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] auth_strategy = keystone {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_availability_zone = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_host = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_stats_polling_interval = 60 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backup_api_class = cinder.backup.api.API {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backup_name_template = backup-%s {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backup_use_same_host = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backup_use_temp_snapshot = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] chap_password = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] chap_username = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cinder_internal_tenant_project_id = 13f335c12785462fa54f9006dcca5c32 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cinder_internal_tenant_user_id = 187d6a71039f4b309c88bab670c55ce3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cluster = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] compression_format = gzip {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] compute_api_class = cinder.compute.nova.API {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] config_dir = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] config_source = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] control_exchange = openstack {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] debug = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] default_availability_zone = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] default_group_type = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] default_volume_type = QuobyteHD {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] disk_geometry = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] driver_client_cert = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] driver_client_cert_key = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] driver_data_namespace = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] driver_ssl_cert_path = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] driver_ssl_cert_verify = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] driver_use_ssl = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] enable_new_services = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] enable_unsupported_driver = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] enabled_backends = ['QuobyteHD'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] enforce_multipath_for_image_xfer = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] filter_function = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_api_insecure = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_api_ssl_compression = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_ca_certificates_file = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_catalog_info = image:glance:publicURL {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_certfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_keyfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_num_retries = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance_request_timeout = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] goodness_function = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] graceful_shutdown_timeout = 5 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] group_api_class = cinder.group.api.API {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] host = devstack {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_compress_on_upload = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_conversion_address_space_limit = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_conversion_cpu_limit = 60 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_conversion_disable = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_upload_use_cinder_backend = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_upload_use_internal_tenant = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_volume_cache_enabled = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_volume_cache_max_count = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] image_volume_cache_max_size_gb = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] init_host_max_objects_retrieval = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] instance_format = [instance: %(uuid)s] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] iscsi_target_flags = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84201) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] iscsi_write_cache = on {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] iser_helper = tgtadm {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] iser_ip_address = 192.168.122.67 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] iser_port = 3260 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] log_color = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] log_config_append = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] log_dir = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] log_file = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] log_options = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] log_rotate_interval = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] log_rotate_interval_type = days {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] log_rotation_type = none {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] max_age = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] max_logfile_count = 30 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] max_logfile_size_mb = 200 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] max_over_subscription_ratio = 20.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] message_reap_interval = 86400 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] message_ttl = 2592000 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] migration_create_volume_timeout_secs = 300 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] monkey_patch = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] monkey_patch_modules = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] my_ip = 192.168.122.67 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] no_snapshot_gb_quota = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] num_iser_scan_tries = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] num_shell_tries = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] num_volume_device_scan_tries = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] nvmeof_conn_info_version = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] nvmet_ns_id = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] nvmet_port_id = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] osapi_max_limit = 1000 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] osapi_volume_ext_list = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] osapi_volume_listen = 0.0.0.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] osapi_volume_listen_port = 8776 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] osapi_volume_use_ssl = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] osapi_volume_workers = 2 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] per_volume_size_limit = -1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] periodic_fuzzy_delay = 60 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] periodic_interval = 60 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] project_id_regex = [0-9a-f\-]+ {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] public_endpoint = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] publish_errors = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] quota_backup_gigabytes = 1000 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] quota_backups = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] quota_gigabytes = 1000 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] quota_groups = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] quota_snapshots = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] quota_volumes = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] rate_limit_burst = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] rate_limit_except_level = CRITICAL {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] rate_limit_interval = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] reinit_driver_count = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] replication_device = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] report_discard_supported = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] report_interval = 120 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] reservation_clean_interval = 86400 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] reservation_expire = 86400 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] reserved_image_namespaces = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] reserved_percentage = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] rpc_response_timeout = 120 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] run_external_periodic_tasks = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] scst_target_driver = iscsi {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] scst_target_iqn_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_down_time = 720 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] shell_completion = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] snapshot_name_template = snapshot-%s {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] split_loggers = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] state_path = /opt/stack/data/cinder {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] storage_availability_zone = nova {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] storage_protocol = iSCSI {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] syslog_log_facility = LOG_USER {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] target_helper = lioadm {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] target_ip_address = 192.168.122.67 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] target_port = 3260 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] target_protocol = iscsi {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] target_secondary_ip_addresses = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] trace_flags = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] transfer_api_class = cinder.transfer.api.API {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] transport_url = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] until_refresh = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] use_chap_auth = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] use_default_quota_class = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] use_journal = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] use_json = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] use_multipath_for_image_xfer = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] use_stderr = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] use_syslog = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] verify_glance_signatures = enabled {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_api_class = cinder.volume.api.API {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_backend_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_clear = zero {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_clear_ionice = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_clear_size = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_copy_bps_limit = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_dd_blocksize = 1M {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_name_template = volume-%s {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_service_inithost_offload = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volume_usage_audit_period = month {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] zoning_mode = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_concurrency.disable_process_locking = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.admin_password = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.admin_token = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.admin_user = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.auth_admin_prefix = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.auth_port = 35357 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.auth_protocol = https {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.auth_section = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.auth_type = password {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.auth_uri = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.auth_version = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.cache = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.certfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.delay_auth_decision = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.http_connect_timeout = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.identity_uri = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.include_service_catalog = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.insecure = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.interface = public {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.keyfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_password = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcache_username = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.region_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.service_token_roles_required = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.service_type = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.token_cache_time = 300 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.67/identity {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.backend = dogpile.cache.null {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.backend_argument = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.backend_expiration_time = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.config_prefix = cache.oslo {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.debug_cache_backend = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.enable_retry_client = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.enable_socket_keepalive = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.enabled = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.enforce_fips_mode = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.expiration_time = 600 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.hashclient_retry_attempts = 2 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.memcache_dead_retry = 300 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84201) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 16:41:59 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.quobyte [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.memcache_pool_maxsize = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.memcache_sasl_enabled = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.password = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.proxies = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.quobyte [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.redis_db = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.redis_sentinel_service_name = mymaster {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.redis_server = localhost:6379 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.retry_attempts = 2 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Running cmd (subprocess): mount.quobyte {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.retry_delay = 0.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.socket_keepalive_count = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.socket_keepalive_idle = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.socket_keepalive_interval = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.socket_timeout = 1.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.tls_allowed_ciphers = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.tls_cafile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.tls_certfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.tls_enabled = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.tls_keyfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cache.username = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] coordination.backend_url = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.asyncio_connection = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.asyncio_slave_connection = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.backend = sqlalchemy {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.connection = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.connection_debug = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.connection_parameters = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.connection_recycle_time = 3600 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.connection_trace = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.db_inc_retry_interval = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.db_max_retries = 20 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.db_max_retry_interval = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.db_retry_interval = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.max_overflow = 50 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.max_pool_size = 5 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.max_retries = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.mysql_wsrep_sync_wait = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.pool_timeout = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.retry_interval = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.slave_connection = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.sqlite_synchronous = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.synchronous_reader = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] database.use_db_reconnect = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.connection_string = messaging:// {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.enabled = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.es_doc_type = notification {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.es_scroll_size = 10000 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.es_scroll_time = 2m {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.filter_error_trace = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.hmac_keys = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.sentinel_service_name = mymaster {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.socket_timeout = 0.1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.trace_requests = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler.trace_sqlalchemy = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler_jaeger.process_tags = {} {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler_jaeger.service_name_prefix = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] profiler_otlp.service_name_prefix = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.enforce_new_defaults = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: WARNING oslo_config.cfg [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.enforce_scope = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.policy_default_rule = default {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.policy_file = policy.yaml {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_policy.remote_timeout = 60.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] privsep_osbrick.group = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] privsep_osbrick.helper_command = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] privsep_osbrick.user = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cinder_sys_admin.group = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cinder_sys_admin.helper_command = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] cinder_sys_admin.user = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.auth_section = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.auth_type = password {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.cafile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.certfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.collect_timing = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.insecure = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.keyfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.send_service_user_token = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.split_loggers = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] service_user.timeout = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.auth_section = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.auth_type = password {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.certfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.collect_timing = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.insecure = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.keyfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.region_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.split_loggers = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] glance.timeout = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.backend_availability_zone = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.chap_password = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.chap_username = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.disk_geometry = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.driver_client_cert = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.driver_client_cert_key = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.driver_data_namespace = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.driver_use_ssl = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.enable_unsupported_driver = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.extra_capabilities = {} {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.filter_function = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.goodness_function = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.iscsi_target_flags = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.iscsi_write_cache = on {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.iser_helper = tgtadm {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.iser_port = 3260 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_host = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_login = admin {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_mount_options = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_password = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_private_key = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_share_path = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_ssh_port = 22 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.num_shell_tries = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.nvmet_port_id = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.quobyte_client_cfg = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.quobyte_volume_url = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.replication_device = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.report_discard_supported = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.reserved_percentage = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.scst_target_driver = iscsi {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.scst_target_iqn_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.storage_protocol = iSCSI {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.target_helper = tgtadm {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.target_port = 3260 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.target_protocol = iscsi {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.trace_flags = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.unique_fqdn_network = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.use_chap_auth = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.volume_backend_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.volume_clear = zero {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.volume_clear_ionice = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.volume_clear_size = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_reports.file_event_handler = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_reports.log_dir = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.backend_availability_zone = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.backend_host = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.chap_password = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.chap_username = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.chiscsi_conf = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.disk_geometry = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.driver_client_cert = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.driver_client_cert_key = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.driver_data_namespace = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.driver_use_ssl = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.extra_capabilities = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.filter_function = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.goodness_function = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack quobyte-client[84202]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack quobyte-client[84202]: Invalid parameters found, error: missing mount point. Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.iscsi_target_flags = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.iscsi_write_cache = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.iser_helper = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack quobyte-client[84202]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.iser_ip_address = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.iser_port = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.iser_target_prefix = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack quobyte-client[84202]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_host = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_login = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_mount_options = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_password = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_private_key = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_share_path = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_ssh_port = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.num_shell_tries = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nvmet_ns_id = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.nvmet_port_id = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.replication_device = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.report_discard_supported = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.reserved_percentage = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.scst_target_driver = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.storage_protocol = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.target_helper = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.target_ip_address = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.target_port = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.target_prefix = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.target_protocol = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.trace_flags = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.unique_fqdn_network = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.use_chap_auth = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.volume_clear = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.volume_clear_ionice = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.volume_clear_size = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] QuobyteHD.volumes_dir = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack sudo[84203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:41:59 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.ssl = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.ssl_version = {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_notifications.driver = [] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_notifications.retry = -1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] oslo_messaging_notifications.transport_url = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] key_manager.fixed_key = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.barbican_api_version = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.barbican_endpoint = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.barbican_endpoint_type = public {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.barbican_region_name = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.cafile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.certfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.collect_timing = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.insecure = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.keyfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.number_of_retries = 60 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.retry_delay = 1 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.send_service_user_token = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.split_loggers = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.timeout = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.verify_ssl = True {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican.verify_ssl_path = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican_service_user.auth_section = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican_service_user.auth_type = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican_service_user.cafile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican_service_user.certfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican_service_user.collect_timing = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican_service_user.insecure = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican_service_user.keyfile = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican_service_user.split_loggers = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] barbican_service_user.timeout = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.approle_role_id = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.approle_secret_id = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.kv_mountpoint = secret {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.kv_path = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.kv_version = 2 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.namespace = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.root_token_id = **** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.ssl_ca_crt_file = None {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.timeout = 60.0 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.use_ssl = False {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:41:59 devstack cinder-volume[83942]: DEBUG oslo_service.backend._eventlet.service [None req-7a233091-e3aa-45c9-9558-2798171b035c None None] ******************************************************************************** {{(pid=83942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 16:42:00 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.575s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:42:00 devstack cinder-volume[84201]: INFO cinder.volume.driver [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG cinder.volume.driver [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5835723876953, 'free_capacity_gb': 1775.5835723876953, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84201) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84201) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writer thread running {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG cinder.db.sqlalchemy.api [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Building query based on filter {{(pid=84201) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84201) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:42:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:42:00 devstack cinder-volume[84201]: INFO cinder.keymgr.migration [None req-405f08c2-b2a3-45c9-ab64-1efaba438d6a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 16:42:00 devstack sudo[84206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:42:00 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:42:01 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.575s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:42:01 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Driver initialization completed successfully. Apr 29 16:42:01 devstack cinder-volume[84201]: INFO cinder.manager [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Initiating service 3 cleanup Apr 29 16:42:01 devstack cinder-volume[84201]: INFO cinder.manager [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Service 3 cleanup completed. Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG cinder.service [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Creating RPC server for service cinder-volume {{(pid=84201) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG cinder.service [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84201) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 16:42:01 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:42:01 devstack sudo[84212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:42:01 devstack sudo[84212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:42:01 devstack sudo[84212]: pam_unix(sudo:session): session closed for user root Apr 29 16:42:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.578s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:42:01 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7fe71081-aabb-4d96-9c2a-a4d77b58f7a5 None None] Driver post RPC initialization completed successfully. Apr 29 16:42:09 devstack cinder-volume[83942]: DEBUG dbcounter [-] [83942] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:42:11 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Flow 'volume_create_manager' (86c3671f-cd2f-4e4a-8243-12ef3bcf66a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f816e9-a03e-4661-a049-7790d5774614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Flow 'volume_create_manager' (66d82318-2ba5-4b7a-a3a3-73e17593ae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78de5631-f4d8-4f40-91d0-0498cdaea7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78de5631-f4d8-4f40-91d0-0498cdaea7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1642175897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fda6f4c-9bbe-492d-90b9-afeacb851762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1de91ea0ca42c98aa549aab9c4ae50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:42:58Z,use_quota=True,user_id='56a3a53e6ab7448c87c3a1de9f58f117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9195c9cc-2f1b-4a2e-9578-71800ac9b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9195c9cc-2f1b-4a2e-9578-71800ac9b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ac88aa-c0d2-425b-9a8f-f8b2194d4ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ac88aa-c0d2-425b-9a8f-f8b2194d4ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fda6f4c-9bbe-492d-90b9-afeacb851762', 'volume_name': 'volume-4fda6f4c-9bbe-492d-90b9-afeacb851762', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda99eac-2cae-4bdf-bc05-3f6af8294b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda99eac-2cae-4bdf-bc05-3f6af8294b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d66d53-71ed-4418-b1b5-8d678d803fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Volume 4fda6f4c-9bbe-492d-90b9-afeacb851762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fda6f4c-9bbe-492d-90b9-afeacb851762', 'volume_size': 1} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1642175897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fda6f4c-9bbe-492d-90b9-afeacb851762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1de91ea0ca42c98aa549aab9c4ae50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:42:58Z,use_quota=True,user_id='56a3a53e6ab7448c87c3a1de9f58f117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Creating volume 4fda6f4c-9bbe-492d-90b9-afeacb851762 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:42:58 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f816e9-a03e-4661-a049-7790d5774614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1783952985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b0e162-b217-4612-aa12-9f08ae642eba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='505be7d7e8664282a91783761dd263c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:42:58Z,use_quota=True,user_id='d7e61db5782d41868c79e979c7b2d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0154dee-6e46-416f-b986-d3ff4d0e1d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0154dee-6e46-416f-b986-d3ff4d0e1d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76d1ea7-d680-4fc4-904c-1383fe122f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76d1ea7-d680-4fc4-904c-1383fe122f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b0e162-b217-4612-aa12-9f08ae642eba', 'volume_name': 'volume-73b0e162-b217-4612-aa12-9f08ae642eba', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e14d374-4bc2-45a3-bb68-b00a1abd1730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e14d374-4bc2-45a3-bb68-b00a1abd1730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:42:58 devstack sudo[84602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 1073741824 Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be01de46-6efc-4f35-aacc-7c90240a8e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:42:58 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Volume 73b0e162-b217-4612-aa12-9f08ae642eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b0e162-b217-4612-aa12-9f08ae642eba', 'volume_size': 1} Apr 29 16:42:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:42:58 devstack sudo[84602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:00 devstack sudo[84602]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 1073741824" returned: 0 in 1.658s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:00 devstack sudo[84965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 Apr 29 16:43:00 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:01 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762" returned: 0 in 0.986s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] <== create_volume: return (2745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.757s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.653s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1783952985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b0e162-b217-4612-aa12-9f08ae642eba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='505be7d7e8664282a91783761dd263c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:42:58Z,use_quota=True,user_id='d7e61db5782d41868c79e979c7b2d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Creating volume 73b0e162-b217-4612-aa12-9f08ae642eba {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:43:01 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:01 devstack sudo[84970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba 1073741824 Apr 29 16:43:01 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d66d53-71ed-4418-b1b5-8d678d803fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fda6f4c-9bbe-492d-90b9-afeacb851762', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c3878f-61ef-4f9a-acfa-1ffe12eaaff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:01 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Volume volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 (4fda6f4c-9bbe-492d-90b9-afeacb851762): created successfully Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c3878f-61ef-4f9a-acfa-1ffe12eaaff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Flow 'volume_create_manager' (66d82318-2ba5-4b7a-a3a3-73e17593ae83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:01 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5d888e38-b42c-4be6-8b1f-a185b9738ae9 tempest-DeleteServersTestJSON-1810112203 None] Created volume successfully. Apr 29 16:43:02 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba 1073741824" returned: 0 in 1.257s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:02 devstack sudo[84978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba Apr 29 16:43:02 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:03 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba" returned: 0 in 0.705s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:43:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be01de46-6efc-4f35-aacc-7c90240a8e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b0e162-b217-4612-aa12-9f08ae642eba', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3954e1-9e78-4ece-865f-05d9845afa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:03 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Volume volume-73b0e162-b217-4612-aa12-9f08ae642eba (73b0e162-b217-4612-aa12-9f08ae642eba): created successfully Apr 29 16:43:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3954e1-9e78-4ece-865f-05d9845afa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Flow 'volume_create_manager' (86c3671f-cd2f-4e4a-8243-12ef3bcf66a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5598d8a5-2e6d-4e9b-88fd-beb9267f9a20 tempest-VolumesTestJSON-1610645287 None] Created volume successfully. Apr 29 16:43:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:43:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:04 devstack sudo[84987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:43:04 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Flow 'volume_create_manager' (347326e1-29f9-4156-9aa4-2e640ed61f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e3b783-8055-4a8f-af92-24caa74cdb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e3b783-8055-4a8f-af92-24caa74cdb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1263388405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb477fad-5605-433a-b983-e1de6939f035,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='505be7d7e8664282a91783761dd263c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:05Z,use_quota=True,user_id='d7e61db5782d41868c79e979c7b2d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d93c72-a4e0-4e38-aea5-018f72042ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d93c72-a4e0-4e38-aea5-018f72042ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9006a7c-5632-4f93-ba72-e7320090b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9006a7c-5632-4f93-ba72-e7320090b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb477fad-5605-433a-b983-e1de6939f035', 'volume_name': 'volume-cb477fad-5605-433a-b983-e1de6939f035', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b0ae8b-3372-4f17-98a9-c8577a3a443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b0ae8b-3372-4f17-98a9-c8577a3a443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc47d86-1a32-40a5-9cec-d95e609226db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:05 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Volume cb477fad-5605-433a-b983-e1de6939f035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb477fad-5605-433a-b983-e1de6939f035', 'volume_size': 1} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1263388405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb477fad-5605-433a-b983-e1de6939f035,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='505be7d7e8664282a91783761dd263c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:05Z,use_quota=True,user_id='d7e61db5782d41868c79e979c7b2d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Creating volume cb477fad-5605-433a-b983-e1de6939f035 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:43:05 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:43:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:05 devstack sudo[85007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035 1073741824 Apr 29 16:43:05 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:06 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.218s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:06 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:43:06 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035 1073741824" returned: 0 in 1.500s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:07 devstack sudo[85056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035 Apr 29 16:43:07 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:08 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035" returned: 0 in 1.096s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] <== create_volume: return (2685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:43:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.694s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc47d86-1a32-40a5-9cec-d95e609226db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb477fad-5605-433a-b983-e1de6939f035', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff53eb5a-1d1d-477e-97b8-39b6f2a97ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:08 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Volume volume-cb477fad-5605-433a-b983-e1de6939f035 (cb477fad-5605-433a-b983-e1de6939f035): created successfully Apr 29 16:43:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff53eb5a-1d1d-477e-97b8-39b6f2a97ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Flow 'volume_create_manager' (347326e1-29f9-4156-9aa4-2e640ed61f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:08 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-9d8de672-cd44-4fda-8f61-c8d194cdae26 tempest-VolumesTestJSON-1610645287 None] Created volume successfully. Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Flow 'volume_create_manager' (ca357bc1-9d48-4514-89e3-7a648ebea9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b21509-7218-40b0-b465-fdd78deb7373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b21509-7218-40b0-b465-fdd78deb7373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-990872543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2fd25d-0ea2-44aa-902a-93c9b601b564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='505be7d7e8664282a91783761dd263c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:10Z,use_quota=True,user_id='d7e61db5782d41868c79e979c7b2d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0209d2a-2f76-4077-a6c8-f0cad89478a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0209d2a-2f76-4077-a6c8-f0cad89478a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78350c3e-3151-4ca4-a72a-f5abe76396e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78350c3e-3151-4ca4-a72a-f5abe76396e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2fd25d-0ea2-44aa-902a-93c9b601b564', 'volume_name': 'volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7524c1-e600-4827-a91c-82c458cf841a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7524c1-e600-4827-a91c-82c458cf841a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7076c082-35d8-4db3-a322-313ae6f29f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:10 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Volume fd2fd25d-0ea2-44aa-902a-93c9b601b564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564', 'volume_size': 1} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-990872543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2fd25d-0ea2-44aa-902a-93c9b601b564,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='505be7d7e8664282a91783761dd263c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:10Z,use_quota=True,user_id='d7e61db5782d41868c79e979c7b2d662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Creating volume fd2fd25d-0ea2-44aa-902a-93c9b601b564 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:43:10 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:10 devstack sudo[85072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 1073741824 Apr 29 16:43:10 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:10 devstack cinder-volume[84201]: WARNING py.warnings [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 29 16:43:10 devstack cinder-volume[84201]: .first() Apr 29 16:43:10 devstack cinder-volume[84201]: Apr 29 16:43:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:11 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 1073741824" returned: 0 in 1.611s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:12 devstack sudo[85107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 Apr 29 16:43:12 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:12 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564" returned: 0 in 0.782s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] <== create_volume: return (2489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:43:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.492s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.881s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:12 devstack cinder-volume[84201]: INFO oslo.privsep.daemon [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm53rdjl6/privsep.sock'] Apr 29 16:43:12 devstack sudo[85111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm53rdjl6/privsep.sock Apr 29 16:43:12 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7076c082-35d8-4db3-a322-313ae6f29f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf9c116-ebd8-4b4b-bfb7-afa9969003b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:12 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Volume volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 (fd2fd25d-0ea2-44aa-902a-93c9b601b564): created successfully Apr 29 16:43:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf9c116-ebd8-4b4b-bfb7-afa9969003b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Flow 'volume_create_manager' (ca357bc1-9d48-4514-89e3-7a648ebea9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:12 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-19400e4b-717f-4a80-b484-073da553e821 tempest-VolumesTestJSON-1610645287 None] Created volume successfully. Apr 29 16:43:14 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:14 devstack cinder-volume[84201]: INFO oslo.privsep.daemon [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] Spawned new privsep daemon via rootwrap Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] Accepted privsep connection to /tmp/tmpm53rdjl6/privsep.sock {{(pid=84201) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 16:43:14 devstack cinder-volume[84201]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 16:43:14 devstack cinder-volume[84201]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 16:43:14 devstack cinder-volume[84201]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 16:43:14 devstack cinder-volume[84201]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85117 Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25e6106-ebac-4902-b92a-efb49c61d3e2]: (2,) {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[85521f6c-ea9e-456a-9628-65a19a1d4476]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:14 devstack sudo[85119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 Apr 29 16:43:14 devstack sudo[85119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "cinder-fd2fd25d-0ea2-44aa-902a-93c9b601b564-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Lock "cinder-fd2fd25d-0ea2-44aa-902a-93c9b601b564-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "cinder-quobyte-fd2fd25d-0ea2-44aa-902a-93c9b601b564" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Lock "cinder-quobyte-fd2fd25d-0ea2-44aa-902a-93c9b601b564" acquired by "delete_volume" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[47504a96-e0e8-4f7a-9aa6-24d325c81fe0]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:15 devstack sudo[85121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 Apr 29 16:43:15 devstack sudo[85121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:15 devstack sudo[85119]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762" returned: 0 in 0.927s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.730s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53', 'name': 'volume-4fda6f4c-9bbe-492d-90b9-afeacb851762', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3b55ed8-be99-4ac0-b1cb-df550fcd7264', 'enforce_multipath': True} {{(pid=84201) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 16:43:15 devstack sudo[85121]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564" returned: 0 in 0.803s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:15 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564 Apr 29 16:43:15 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-a9cadd66-17d0-42a2-a6dc-f836d4de8aea req-276d7b16-9b89-4906-9e93-0ad854286a5e tempest-DeleteServersTestJSON-1810112203 None] attachment_update completed successfully. Apr 29 16:43:16 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd2fd25d-0ea2-44aa-902a-93c9b601b564" returned: 0 in 0.751s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Lock "cinder-quobyte-fd2fd25d-0ea2-44aa-902a-93c9b601b564" released by "delete_volume" :: held 1.604s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:16 devstack cinder-volume[84201]: WARNING cinder.quota [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:43:16 devstack cinder-volume[84201]: WARNING cinder.quota [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:43:16 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Created reservations ['f8e67a50-41f1-4d7f-aace-71e34a6c6439', '726c5a2c-25a2-4014-9997-e18b51d8db84', '4800fb0c-0956-425a-86dc-d5ae6483a48d', '954d549b-3a5b-4ce3-9a62-fbf22c61ce6d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:16 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:16 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:16 devstack sudo[85201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:43:16 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Acquiring lock "cinder-cb477fad-5605-433a-b983-e1de6939f035-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Lock "cinder-cb477fad-5605-433a-b983-e1de6939f035-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Acquiring lock "cinder-quobyte-cb477fad-5605-433a-b983-e1de6939f035" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Lock "cinder-quobyte-cb477fad-5605-433a-b983-e1de6939f035" acquired by "delete_volume" :: waited 0.030s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:17 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8931cd02-060a-444d-b257-d8a485b59e5c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:17 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035 Apr 29 16:43:17 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:17 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.798s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:17 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:43:17 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Deleted volume successfully. Apr 29 16:43:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6c2f4337-cb4a-4ede-a7d7-db6133b9b742 tempest-VolumesTestJSON-1610645287 None] Lock "cinder-fd2fd25d-0ea2-44aa-902a-93c9b601b564-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:18 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035" returned: 0 in 0.822s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:18 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035 Apr 29 16:43:18 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:18 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cb477fad-5605-433a-b983-e1de6939f035" returned: 0 in 0.754s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Lock "cinder-quobyte-cb477fad-5605-433a-b983-e1de6939f035" released by "delete_volume" :: held 1.627s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Created reservations ['88092af6-5bab-4e9e-94c5-b8f61b21e7bc', '4c9630fb-d1cc-4daa-9add-50533b2aa624', 'fe9ba20e-0a71-4337-ae75-31ea396f9eec', 'e57eb30d-9e27-4628-9bfb-a0bc463211fc'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:19 devstack sudo[85532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:43:19 devstack sudo[85532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "cinder-73b0e162-b217-4612-aa12-9f08ae642eba-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Lock "cinder-73b0e162-b217-4612-aa12-9f08ae642eba-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "cinder-quobyte-73b0e162-b217-4612-aa12-9f08ae642eba" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Lock "cinder-quobyte-73b0e162-b217-4612-aa12-9f08ae642eba" acquired by "delete_volume" :: waited 0.036s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a69b92a-dc87-4b9a-9628-91ccc1e7bde4]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:20 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba Apr 29 16:43:20 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:20 devstack sudo[85532]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.237s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:20 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:43:20 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Deleted volume successfully. Apr 29 16:43:20 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bc6ca4f5-b317-4160-9ec9-bb7753dcb4ae tempest-VolumesTestJSON-1610645287 None] Lock "cinder-cb477fad-5605-433a-b983-e1de6939f035-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Flow 'volume_create_manager' (c54fce7a-a922-450b-ab29-8fc14eb90ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ed3c1f-47e9-4456-9af9-597faa0b607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:21 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ed3c1f-47e9-4456-9af9-597faa0b607b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:43:21Z,deleted=False,deleted_at=None,display_description='',display_name='0bba16b2-7332-45b3-a0d7-588eaa04d7b0-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1551f051-1ec6-4ed1-8785-2c7a893175f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b51c090a6d6462eb585410c6b2de0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:21Z,use_quota=True,user_id='e62724bdfb9c4c54b7f55d5fcafbbfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe8465f-03a4-4db4-a840-c0fa13fc1c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe8465f-03a4-4db4-a840-c0fa13fc1c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa71c2f4-2fb4-411a-a406-5d566e63cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa71c2f4-2fb4-411a-a406-5d566e63cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1551f051-1ec6-4ed1-8785-2c7a893175f2', 'volume_name': 'volume-1551f051-1ec6-4ed1-8785-2c7a893175f2', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56ab85a-69b0-4639-aee6-cb7c1c187380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56ab85a-69b0-4639-aee6-cb7c1c187380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af166c28-6ee8-487a-8721-cbf43cbb450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:21 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Volume 1551f051-1ec6-4ed1-8785-2c7a893175f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1551f051-1ec6-4ed1-8785-2c7a893175f2', 'volume_size': 1} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:43:21Z,deleted=False,deleted_at=None,display_description='',display_name='0bba16b2-7332-45b3-a0d7-588eaa04d7b0-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1551f051-1ec6-4ed1-8785-2c7a893175f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b51c090a6d6462eb585410c6b2de0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:21Z,use_quota=True,user_id='e62724bdfb9c4c54b7f55d5fcafbbfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Creating volume 1551f051-1ec6-4ed1-8785-2c7a893175f2 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:43:21 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba" returned: 0 in 1.332s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:21 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 1073741824 Apr 29 16:43:21 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:21 devstack sudo[85543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba Apr 29 16:43:21 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:22 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73b0e162-b217-4612-aa12-9f08ae642eba" returned: 0 in 0.879s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Lock "cinder-quobyte-73b0e162-b217-4612-aa12-9f08ae642eba" released by "delete_volume" :: held 2.352s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Created reservations ['96bc4da4-3915-4080-af5c-b567f8dc7937', '1a7c4deb-48af-4e43-8823-61211472f5bf', '694fc219-5100-47df-b7bc-4e67e0648149', 'e0140ad6-edce-44e0-a7de-2e64dc62d3a5'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:22 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:43:22 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:22 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 1073741824" returned: 0 in 1.192s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:22 devstack sudo[85562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 Apr 29 16:43:22 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:23 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.954s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:43:23 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Deleted volume successfully. Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dd447c5c-770c-46b4-96f6-8f34131df019 tempest-VolumesTestJSON-1610645287 None] Lock "cinder-73b0e162-b217-4612-aa12-9f08ae642eba-delete_volume" released by "delete_volume" :: held 3.667s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:23 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2" returned: 0 in 1.178s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] <== create_volume: return (2421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af166c28-6ee8-487a-8721-cbf43cbb450e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1551f051-1ec6-4ed1-8785-2c7a893175f2', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb082b5-548a-461d-956f-154f58b3c896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:23 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Volume volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 (1551f051-1ec6-4ed1-8785-2c7a893175f2): created successfully Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb082b5-548a-461d-956f-154f58b3c896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Flow 'volume_create_manager' (c54fce7a-a922-450b-ab29-8fc14eb90ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:23 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-6b49d239-1db3-4476-91ed-b8327b14e802 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Created volume successfully. Apr 29 16:43:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-858acb6a-b5e9-47fd-8d73-5eff8a6751d5 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-858acb6a-b5e9-47fd-8d73-5eff8a6751d5 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:24 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[070bed29-934d-45c9-888d-44ac27ed97fb]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-858acb6a-b5e9-47fd-8d73-5eff8a6751d5 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:24 devstack sudo[85640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 Apr 29 16:43:24 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:25 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-858acb6a-b5e9-47fd-8d73-5eff8a6751d5 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2" returned: 0 in 0.920s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-858acb6a-b5e9-47fd-8d73-5eff8a6751d5 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.940s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-858acb6a-b5e9-47fd-8d73-5eff8a6751d5 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53', 'name': 'volume-1551f051-1ec6-4ed1-8785-2c7a893175f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83ae6647-7a13-435f-8536-6ed9dbeee65e', 'enforce_multipath': True} {{(pid=84201) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 16:43:25 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-dc497d40-fb1c-4e32-a6a8-1ab8dbaa9454 req-858acb6a-b5e9-47fd-8d73-5eff8a6751d5 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] attachment_update completed successfully. Apr 29 16:43:27 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-e1f540b8-2743-4867-aabe-db1e4f78247a req-307883b6-a7d5-4cde-a56d-f8f96c920fb5 tempest-DeleteServersTestJSON-1810112203 None] Terminate volume connection completed successfully. Apr 29 16:43:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-e1f540b8-2743-4867-aabe-db1e4f78247a req-307883b6-a7d5-4cde-a56d-f8f96c920fb5 tempest-DeleteServersTestJSON-1810112203 None] Deleting attachment e3b55ed8-be99-4ac0-b1cb-df550fcd7264. {{(pid=84201) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 16:43:28 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-aa12018a-aba2-4928-b9c6-199951b72a1e tempest-GroupsTest-20935080 None] Group tempest-Group1-1467340330: creating Apr 29 16:43:28 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-aa12018a-aba2-4928-b9c6-199951b72a1e tempest-GroupsTest-20935080 None] Group tempest-Group1-1467340330: created successfully Apr 29 16:43:28 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-aa12018a-aba2-4928-b9c6-199951b72a1e tempest-GroupsTest-20935080 None] Create group completed successfully. Apr 29 16:43:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5d158c67-2265-4cef-ba1b-f589b0627145 tempest-GroupsTest-20935080 None] Group tempest-Group2-1613545989: creating Apr 29 16:43:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5d158c67-2265-4cef-ba1b-f589b0627145 tempest-GroupsTest-20935080 None] Group tempest-Group2-1613545989: created successfully Apr 29 16:43:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5d158c67-2265-4cef-ba1b-f589b0627145 tempest-GroupsTest-20935080 None] Create group completed successfully. Apr 29 16:43:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Acquiring lock "cinder-4fda6f4c-9bbe-492d-90b9-afeacb851762-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Lock "cinder-4fda6f4c-9bbe-492d-90b9-afeacb851762-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:31 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:43:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Flow 'volume_create_manager' (f85a6c70-0a36-4028-911c-277af2104f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b026b789-67d9-4569-a9ed-21a1bce51895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b026b789-67d9-4569-a9ed-21a1bce51895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941994319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18353059-7e04-4ffd-9435-2d58d9539a5e,host='devstack@QuobyteHD#QuobyteHD',id=1865357b-f51f-4024-a757-76cd4129ae54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389ccf71e90457082bc407685c0d52d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:32Z,use_quota=True,user_id='c980d5c62b9c4446a9c8887aa1f768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4697fce6-795d-4fcd-a68e-d355c355e1f2),volume_type_id=4697fce6-795d-4fcd-a68e-d355c355e1f2)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e13b35-af91-44f3-9c44-de04557ec8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e13b35-af91-44f3-9c44-de04557ec8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1a0eab-2ced-4b56-a7ab-e115f3a3fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1a0eab-2ced-4b56-a7ab-e115f3a3fae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1865357b-f51f-4024-a757-76cd4129ae54', 'volume_name': 'volume-1865357b-f51f-4024-a757-76cd4129ae54', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6740d6a9-3fe8-4436-92ef-b9be76fe0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6740d6a9-3fe8-4436-92ef-b9be76fe0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788c16be-a204-4c82-8ca9-2dc556eafcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:32 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Volume 1865357b-f51f-4024-a757-76cd4129ae54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1865357b-f51f-4024-a757-76cd4129ae54', 'volume_size': 1} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=18353059-7e04-4ffd-9435-2d58d9539a5e,created_at=2026-04-29T14:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941994319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18353059-7e04-4ffd-9435-2d58d9539a5e,host='devstack@QuobyteHD#QuobyteHD',id=1865357b-f51f-4024-a757-76cd4129ae54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389ccf71e90457082bc407685c0d52d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:32Z,use_quota=True,user_id='c980d5c62b9c4446a9c8887aa1f768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4697fce6-795d-4fcd-a68e-d355c355e1f2),volume_type_id=4697fce6-795d-4fcd-a68e-d355c355e1f2)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Creating volume 1865357b-f51f-4024-a757-76cd4129ae54 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:43:32 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Acquiring lock "cinder-quobyte-4fda6f4c-9bbe-492d-90b9-afeacb851762" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:32 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54 1073741824 Apr 29 16:43:32 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Lock "cinder-quobyte-4fda6f4c-9bbe-492d-90b9-afeacb851762" acquired by "delete_volume" :: waited 0.039s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d645d27-c4ee-4255-b323-6923878aa999]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:32 devstack sudo[86068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 Apr 29 16:43:32 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:32 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54 1073741824" returned: 0 in 0.886s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:33 devstack sudo[86076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54 Apr 29 16:43:33 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:33 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762" returned: 0 in 0.977s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:33 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762 Apr 29 16:43:33 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:33 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54" returned: 0 in 0.632s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788c16be-a204-4c82-8ca9-2dc556eafcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1865357b-f51f-4024-a757-76cd4129ae54', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bd602b-2478-4ef8-a8b2-1ddd86c6e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:33 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Volume volume-1865357b-f51f-4024-a757-76cd4129ae54 (1865357b-f51f-4024-a757-76cd4129ae54): created successfully Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bd602b-2478-4ef8-a8b2-1ddd86c6e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Flow 'volume_create_manager' (f85a6c70-0a36-4028-911c-277af2104f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b6f3f5c7-6692-4cd3-9589-484d01e282cd tempest-GroupsTest-20935080 None] Created volume successfully. Apr 29 16:43:33 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4fda6f4c-9bbe-492d-90b9-afeacb851762" returned: 0 in 0.708s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Lock "cinder-quobyte-4fda6f4c-9bbe-492d-90b9-afeacb851762" released by "delete_volume" :: held 1.750s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Created reservations ['8f6a1018-3f8c-4410-a2e4-88629c0a7b5f', 'd323400d-29ac-4941-b28a-0f3d0beaa60b', 'eb083dff-d7f1-44b6-a26b-133a87a05ac2', 'd895de01-6db2-4d4c-93c5-24f3372d03d1'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:33 devstack sudo[86083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:43:33 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:34 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.658s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:34 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:43:34 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Deleted volume successfully. Apr 29 16:43:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2405ab85-f144-45c5-b1b0-d9bc64c98444 tempest-DeleteServersTestJSON-1810112203 None] Lock "cinder-4fda6f4c-9bbe-492d-90b9-afeacb851762-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Acquiring lock "cinder-quobyte-1865357b-f51f-4024-a757-76cd4129ae54" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Lock "cinder-quobyte-1865357b-f51f-4024-a757-76cd4129ae54" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:35 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b5cafa-e72d-4797-bb44-0f9bdb6b4e05]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:35 devstack sudo[86086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54 Apr 29 16:43:35 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:36 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54" returned: 0 in 0.789s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:36 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54 Apr 29 16:43:36 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:36 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1865357b-f51f-4024-a757-76cd4129ae54" returned: 0 in 0.696s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Lock "cinder-quobyte-1865357b-f51f-4024-a757-76cd4129ae54" released by "delete_volume" :: held 1.558s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:36 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Created reservations ['a9585c34-fd57-4e2b-85c2-67caf0fd6fb1'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:36 devstack cinder-volume[84201]: WARNING cinder.quota [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1188800868 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1188800868, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:43:36 devstack cinder-volume[84201]: WARNING cinder.quota [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1188800868 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1188800868, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:43:36 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Created reservations ['5fa9725e-5093-4be8-905c-2bd764f22b5e', 'aadf8d07-46ee-4fdf-9982-1de0bc7a39fd', 'e86da5ba-97cb-4d4b-9844-7ee07d35d06d', '41a01ca9-c86f-4ea9-b759-beeb3cd6428d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:37 devstack sudo[86097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:43:37 devstack sudo[86097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] Created reservations ['f6cef038-aa26-4034-8752-ebc41f909422'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:38 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:43:38 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:38 devstack sudo[86097]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.949s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:38 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:43:38 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c7fc9e48-32ad-41fe-b28a-bfe2eaee0b4e tempest-GroupsTest-20935080 None] Delete group completed successfully. Apr 29 16:43:38 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.758s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:38 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:43:38 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d598d64d-1fac-4621-b3c1-69366341f1d0 tempest-GroupsTest-20935080 None] Delete group completed successfully. Apr 29 16:43:39 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-248f8c8d-8020-4613-8089-37ae9e224f57 tempest-GroupsTest-20935080 None] Group tempest-GroupsTest-Group-1156443641: creating Apr 29 16:43:39 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-248f8c8d-8020-4613-8089-37ae9e224f57 tempest-GroupsTest-20935080 None] Group tempest-GroupsTest-Group-1156443641: created successfully Apr 29 16:43:39 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-248f8c8d-8020-4613-8089-37ae9e224f57 tempest-GroupsTest-20935080 None] Create group completed successfully. Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Flow 'volume_create_manager' (dac292dd-19d1-4e96-8180-733482ff07bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fb32b6-0526-4a55-adec-6d331b5ff464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fb32b6-0526-4a55-adec-6d331b5ff464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318541897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1b2b30f-f2bb-464b-88cc-95a8b3c5792e,host='devstack@QuobyteHD#QuobyteHD',id=8c23f45c-70f1-443a-86a7-82e636d75265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389ccf71e90457082bc407685c0d52d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:41Z,use_quota=True,user_id='c980d5c62b9c4446a9c8887aa1f768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b73a1130-d309-42f9-933b-a9f961155471),volume_type_id=b73a1130-d309-42f9-933b-a9f961155471)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052ca9a3-6029-4594-afac-01bd221b4d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052ca9a3-6029-4594-afac-01bd221b4d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d33e529-71c2-4ef6-b678-d6db83b088ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d33e529-71c2-4ef6-b678-d6db83b088ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c23f45c-70f1-443a-86a7-82e636d75265', 'volume_name': 'volume-8c23f45c-70f1-443a-86a7-82e636d75265', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df94699-827e-44ef-a9ab-7259eaaaad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df94699-827e-44ef-a9ab-7259eaaaad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61514e07-8bdc-42ec-ab20-0645b3fd6d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:41 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Volume 8c23f45c-70f1-443a-86a7-82e636d75265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c23f45c-70f1-443a-86a7-82e636d75265', 'volume_size': 1} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1b2b30f-f2bb-464b-88cc-95a8b3c5792e,created_at=2026-04-29T14:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318541897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1b2b30f-f2bb-464b-88cc-95a8b3c5792e,host='devstack@QuobyteHD#QuobyteHD',id=8c23f45c-70f1-443a-86a7-82e636d75265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389ccf71e90457082bc407685c0d52d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:41Z,use_quota=True,user_id='c980d5c62b9c4446a9c8887aa1f768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b73a1130-d309-42f9-933b-a9f961155471),volume_type_id=b73a1130-d309-42f9-933b-a9f961155471)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Creating volume 8c23f45c-70f1-443a-86a7-82e636d75265 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:43:41 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:43:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:41 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265 1073741824 Apr 29 16:43:41 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:42 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265 1073741824" returned: 0 in 1.192s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:42 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265 Apr 29 16:43:42 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:43 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265" returned: 0 in 0.804s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:43:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61514e07-8bdc-42ec-ab20-0645b3fd6d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c23f45c-70f1-443a-86a7-82e636d75265', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e25e7d-1082-41c4-b5c5-937fc865038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:43 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Volume volume-8c23f45c-70f1-443a-86a7-82e636d75265 (8c23f45c-70f1-443a-86a7-82e636d75265): created successfully Apr 29 16:43:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e25e7d-1082-41c4-b5c5-937fc865038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Flow 'volume_create_manager' (dac292dd-19d1-4e96-8180-733482ff07bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:43 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-482a200e-5e2d-4478-a7b3-4e39ef6adcec tempest-GroupsTest-20935080 None] Created volume successfully. Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Flow 'volume_create_manager' (5dc6176a-9c84-4913-8fec-a63715a25732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f9eef6-02d8-45d4-ba76-77f3122deae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f9eef6-02d8-45d4-ba76-77f3122deae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-28486792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1b2b30f-f2bb-464b-88cc-95a8b3c5792e,host='devstack@QuobyteHD#QuobyteHD',id=26405412-c04e-43f2-92f4-31526f6ad4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389ccf71e90457082bc407685c0d52d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:44Z,use_quota=True,user_id='c980d5c62b9c4446a9c8887aa1f768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b73a1130-d309-42f9-933b-a9f961155471),volume_type_id=b73a1130-d309-42f9-933b-a9f961155471)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c630b22-63ab-443e-80ca-287b9a319406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c630b22-63ab-443e-80ca-287b9a319406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0fbd61-5218-454f-9581-2a026597c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0fbd61-5218-454f-9581-2a026597c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26405412-c04e-43f2-92f4-31526f6ad4ef', 'volume_name': 'volume-26405412-c04e-43f2-92f4-31526f6ad4ef', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d6f8ad-f238-446d-859f-3ef0dcfef7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d6f8ad-f238-446d-859f-3ef0dcfef7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2342b9-5f37-405a-a9dd-278a008ba923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:44 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Volume 26405412-c04e-43f2-92f4-31526f6ad4ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26405412-c04e-43f2-92f4-31526f6ad4ef', 'volume_size': 1} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1b2b30f-f2bb-464b-88cc-95a8b3c5792e,created_at=2026-04-29T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-28486792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1b2b30f-f2bb-464b-88cc-95a8b3c5792e,host='devstack@QuobyteHD#QuobyteHD',id=26405412-c04e-43f2-92f4-31526f6ad4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389ccf71e90457082bc407685c0d52d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:43:44Z,use_quota=True,user_id='c980d5c62b9c4446a9c8887aa1f768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b73a1130-d309-42f9-933b-a9f961155471),volume_type_id=b73a1130-d309-42f9-933b-a9f961155471)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Creating volume 26405412-c04e-43f2-92f4-31526f6ad4ef {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:43:44 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:43:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:44 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef 1073741824 Apr 29 16:43:44 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:45 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef 1073741824" returned: 0 in 1.235s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:45 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef Apr 29 16:43:45 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:46 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef" returned: 0 in 0.735s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:43:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2342b9-5f37-405a-a9dd-278a008ba923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26405412-c04e-43f2-92f4-31526f6ad4ef', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c00334-825b-4b53-b870-a321c52b7ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:43:46 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Volume volume-26405412-c04e-43f2-92f4-31526f6ad4ef (26405412-c04e-43f2-92f4-31526f6ad4ef): created successfully Apr 29 16:43:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c00334-825b-4b53-b870-a321c52b7ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:43:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Flow 'volume_create_manager' (5dc6176a-9c84-4913-8fec-a63715a25732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:43:46 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-803a79c5-43be-4f58-b5d0-5a175053cf99 tempest-GroupsTest-20935080 None] Created volume successfully. Apr 29 16:43:47 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-db3e9ea4-7fc4-4cbd-bd3a-98a647267741 tempest-GroupsTest-20935080 None] Update group completed successfully. Apr 29 16:43:49 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-417ba8dd-3401-4e3e-9ae1-d5770d9490c2 tempest-GroupsTest-20935080 None] Update group completed successfully. Apr 29 16:43:50 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=70,cinder:UPDATE=74,cinder:DELETE=7,cinder:INSERT=16 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:43:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Acquiring lock "cinder-quobyte-26405412-c04e-43f2-92f4-31526f6ad4ef" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Lock "cinder-quobyte-26405412-c04e-43f2-92f4-31526f6ad4ef" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:51 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aedb70-8888-4f17-b092-0b42aea613d6]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:51 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef Apr 29 16:43:51 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:51 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef" returned: 0 in 0.774s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:51 devstack sudo[86204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef Apr 29 16:43:51 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:52 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-26405412-c04e-43f2-92f4-31526f6ad4ef" returned: 0 in 1.039s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Lock "cinder-quobyte-26405412-c04e-43f2-92f4-31526f6ad4ef" released by "delete_volume" :: held 1.877s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Acquiring lock "cinder-quobyte-8c23f45c-70f1-443a-86a7-82e636d75265" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:43:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Lock "cinder-quobyte-8c23f45c-70f1-443a-86a7-82e636d75265" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:43:52 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10188c3-8185-45b8-b4c3-f9f801e39491]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:43:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:53 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265 Apr 29 16:43:53 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:54 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265" returned: 0 in 1.205s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:54 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265 Apr 29 16:43:54 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:55 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8c23f45c-70f1-443a-86a7-82e636d75265" returned: 0 in 1.086s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Lock "cinder-quobyte-8c23f45c-70f1-443a-86a7-82e636d75265" released by "delete_volume" :: held 2.370s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:43:55 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=76,cinder:UPDATE=80,cinder:INSERT=14,cinder:DELETE=5 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:43:55 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Created reservations ['09bbea05-9f10-4272-a10d-ddb7829d0e3b'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:55 devstack cinder-volume[84201]: WARNING cinder.quota [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1408434446 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1408434446, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:43:55 devstack cinder-volume[84201]: WARNING cinder.quota [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1408434446 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1408434446, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:43:55 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Created reservations ['118ba032-8d0c-4f65-9b36-09cddae4cf1f', 'd88de4a0-3d12-4ef8-a319-80a650f14611', '13edee0c-c146-4c33-972f-ba19674c592e', '4c25c327-0937-4432-a91e-89e84ffb787b'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:55 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Created reservations ['cbf24a1c-7c65-4fd0-8b7c-b9fbd751a636', 'a5a76eec-0318-4200-998f-11c44f9286b9', '34f4204e-cf8f-4171-a1f7-929ee4f650c6', '8c9b8ddf-cacb-4c03-9553-3c13935cc9d5'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:43:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:43:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:43:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:43:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:43:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:43:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:43:56 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:43:56 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:43:57 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Apr 29 16:43:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.049s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:43:57 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:43:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e814d7d8-645d-471b-97c6-3745762d4f8a tempest-GroupsTest-20935080 None] Delete group completed successfully. Apr 29 16:44:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:44:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:44:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:44:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:04 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:44:04 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:05 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=19 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:44:06 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.300s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:06 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:44:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-720da14c-0261-4c15-9567-98c48393d8ae tempest-GroupsV320Test-843658603 None] Group tempest-GroupsV320Test-Group-886040877: creating Apr 29 16:44:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-720da14c-0261-4c15-9567-98c48393d8ae tempest-GroupsV320Test-843658603 None] Group tempest-GroupsV320Test-Group-886040877: created successfully Apr 29 16:44:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-720da14c-0261-4c15-9567-98c48393d8ae tempest-GroupsV320Test-843658603 None] Create group completed successfully. Apr 29 16:44:08 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] Created reservations ['3f70a02f-50e7-4fa3-a2c4-865baa4be5eb'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:44:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:44:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:44:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:08 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:44:08 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:09 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.635s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:09 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:44:09 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-cbeed3a3-5b5b-4994-80a8-a99b06fd4d2d tempest-GroupsV320Test-843658603 None] Delete group completed successfully. Apr 29 16:44:18 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=25,cinder:SELECT=19,cinder:INSERT=6 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:44:18 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:44:23 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Flow 'volume_create_manager' (38958c89-3cec-4d09-99a8-12d859c22f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f678a83f-4cdb-47b3-89b3-1dec0ad5451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f678a83f-4cdb-47b3-89b3-1dec0ad5451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-24054240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf65144-d5ec-427d-a5e4-8c208ace22a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9b5671d36240dab9457560e5b11b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:24Z,use_quota=True,user_id='84d44993e3624051b1811ba0dbe3ae47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7e654c-9aa7-4ef8-a9c3-8643bdc06e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7e654c-9aa7-4ef8-a9c3-8643bdc06e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0470cd2c-e976-4346-afe4-b0a5cbc7c5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0470cd2c-e976-4346-afe4-b0a5cbc7c5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf65144-d5ec-427d-a5e4-8c208ace22a5', 'volume_name': 'volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f7ed1e-457d-406d-919a-c1e92fcb4d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f7ed1e-457d-406d-919a-c1e92fcb4d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206f13b8-86ac-47fa-972e-629c121fa3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:24 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Volume 2cf65144-d5ec-427d-a5e4-8c208ace22a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5', 'volume_size': 1} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-24054240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf65144-d5ec-427d-a5e4-8c208ace22a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9b5671d36240dab9457560e5b11b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:24Z,use_quota=True,user_id='84d44993e3624051b1811ba0dbe3ae47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Creating volume 2cf65144-d5ec-427d-a5e4-8c208ace22a5 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:44:24 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:44:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:24 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 1073741824 Apr 29 16:44:24 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:25 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 1073741824" returned: 0 in 1.527s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:25 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 Apr 29 16:44:25 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:27 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5" returned: 0 in 1.485s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] <== create_volume: return (3082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:44:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.087s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206f13b8-86ac-47fa-972e-629c121fa3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e569b616-e1da-47ab-b494-2a0f5c5c523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:27 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Volume volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 (2cf65144-d5ec-427d-a5e4-8c208ace22a5): created successfully Apr 29 16:44:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e569b616-e1da-47ab-b494-2a0f5c5c523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Flow 'volume_create_manager' (38958c89-3cec-4d09-99a8-12d859c22f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:44:27 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f9ac0a28-5100-4b70-89ac-905e88ebdb5e tempest-VolumesAdminNegativeTest-1078572709 None] Created volume successfully. Apr 29 16:44:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Acquiring lock "cinder-2cf65144-d5ec-427d-a5e4-8c208ace22a5-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:44:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Lock "cinder-2cf65144-d5ec-427d-a5e4-8c208ace22a5-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:44:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Acquiring lock "cinder-quobyte-2cf65144-d5ec-427d-a5e4-8c208ace22a5" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:44:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Lock "cinder-quobyte-2cf65144-d5ec-427d-a5e4-8c208ace22a5" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:44:30 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9075be39-79f4-4372-afd7-b74b8bded0d1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:44:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:31 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 Apr 29 16:44:31 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:32 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5" returned: 0 in 1.404s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:32 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5 Apr 29 16:44:32 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:33 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2cf65144-d5ec-427d-a5e4-8c208ace22a5" returned: 0 in 1.218s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Lock "cinder-quobyte-2cf65144-d5ec-427d-a5e4-8c208ace22a5" released by "delete_volume" :: held 2.780s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:44:33 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Created reservations ['9555e1e4-beef-48dc-a263-c2418eb5a654', '9bd593ed-fe0c-479a-8d9a-316ad493dff7', 'afed1c7b-b297-4cef-9b90-2732453d079c', '6e7f9005-0983-4ce6-99b6-7ee7915ac228'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:44:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:44:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:44:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:33 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:44:33 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:35 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.330s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:44:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Deleted volume successfully. Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d1bac5c-6f25-4b0c-8002-8bf7b8fc852d tempest-VolumesAdminNegativeTest-1078572709 None] Lock "cinder-2cf65144-d5ec-427d-a5e4-8c208ace22a5-delete_volume" released by "delete_volume" :: held 4.626s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Flow 'volume_create_manager' (24974af5-73b2-47af-bc4e-7a2543c3bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b02ea-73b2-4a64-9b4e-69c29c2b987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b02ea-73b2-4a64-9b4e-69c29c2b987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1200351271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19702cb7-39e6-4b81-9196-96f070d21f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f635604828c4689b55e070f9d3c9e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:36Z,use_quota=True,user_id='6c2abded865b40cd8b42a2ad9302a9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ecb2734-c945-4504-a10a-6bf98e8c4291),volume_type_id=7ecb2734-c945-4504-a10a-6bf98e8c4291)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0bc350-272f-402f-bbdb-76cf05602afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0bc350-272f-402f-bbdb-76cf05602afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410281ee-dcf7-4c24-bff1-5329ea147bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410281ee-dcf7-4c24-bff1-5329ea147bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19702cb7-39e6-4b81-9196-96f070d21f02', 'volume_name': 'volume-19702cb7-39e6-4b81-9196-96f070d21f02', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be7798e-d310-4435-a045-34a6d477108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be7798e-d310-4435-a045-34a6d477108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8792c5-7e04-4092-9fc3-c7d8c293e258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:36 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Volume 19702cb7-39e6-4b81-9196-96f070d21f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19702cb7-39e6-4b81-9196-96f070d21f02', 'volume_size': 1} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1200351271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19702cb7-39e6-4b81-9196-96f070d21f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f635604828c4689b55e070f9d3c9e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:36Z,use_quota=True,user_id='6c2abded865b40cd8b42a2ad9302a9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ecb2734-c945-4504-a10a-6bf98e8c4291),volume_type_id=7ecb2734-c945-4504-a10a-6bf98e8c4291)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Creating volume 19702cb7-39e6-4b81-9196-96f070d21f02 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:44:36 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:44:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:36 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02 1073741824 Apr 29 16:44:36 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:37 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02 1073741824" returned: 0 in 1.239s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:37 devstack sudo[86802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02 Apr 29 16:44:37 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:38 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02" returned: 0 in 0.791s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:44:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8792c5-7e04-4092-9fc3-c7d8c293e258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19702cb7-39e6-4b81-9196-96f070d21f02', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68777e49-7208-46d4-a151-0a71a9150ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:38 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Volume volume-19702cb7-39e6-4b81-9196-96f070d21f02 (19702cb7-39e6-4b81-9196-96f070d21f02): created successfully Apr 29 16:44:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68777e49-7208-46d4-a151-0a71a9150ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Flow 'volume_create_manager' (24974af5-73b2-47af-bc4e-7a2543c3bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:44:38 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7d8f498d-152a-44b0-bbb0-978d140bfb49 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Created volume successfully. Apr 29 16:44:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d5e4a195-435c-4ff7-92b2-92676bf69993 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d5e4a195-435c-4ff7-92b2-92676bf69993 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d5e4a195-435c-4ff7-92b2-92676bf69993 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:44:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d5e4a195-435c-4ff7-92b2-92676bf69993 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:44:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d5e4a195-435c-4ff7-92b2-92676bf69993 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d5e4a195-435c-4ff7-92b2-92676bf69993 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:40 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:44:40 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:42 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d5e4a195-435c-4ff7-92b2-92676bf69993 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.741s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:42 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-d5e4a195-435c-4ff7-92b2-92676bf69993 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:44:42 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d5e4a195-435c-4ff7-92b2-92676bf69993 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Retype volume completed successfully. Apr 29 16:44:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Acquiring lock "cinder-19702cb7-39e6-4b81-9196-96f070d21f02-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:44:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "cinder-19702cb7-39e6-4b81-9196-96f070d21f02-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:44:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Acquiring lock "cinder-quobyte-19702cb7-39e6-4b81-9196-96f070d21f02" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:44:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "cinder-quobyte-19702cb7-39e6-4b81-9196-96f070d21f02" acquired by "delete_volume" :: waited 0.057s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:44:42 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bddb91-fef9-4b43-bda2-d00db5ba8c1a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:44:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:42 devstack sudo[86846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02 Apr 29 16:44:42 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:44 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02" returned: 0 in 1.642s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:44 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02 Apr 29 16:44:44 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:45 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-19702cb7-39e6-4b81-9196-96f070d21f02" returned: 0 in 1.523s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "cinder-quobyte-19702cb7-39e6-4b81-9196-96f070d21f02" released by "delete_volume" :: held 3.289s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:44:45 devstack cinder-volume[84201]: WARNING cinder.quota [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:44:45 devstack cinder-volume[84201]: WARNING cinder.quota [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:44:45 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Created reservations ['63d873d4-6a45-48ab-bdf4-f8ce3b3477d4', '0b7e78ad-befd-4ab3-b9a2-186c0c9011ef', '80d7d537-9bd6-4a0d-b931-87afbb9b0440', '9c7b494c-4da6-4fd9-95f7-1e50fa68190c'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:44:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:44:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:44:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:46 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:44:46 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:46 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.857s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:46 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:44:46 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Deleted volume successfully. Apr 29 16:44:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c58dc68f-99be-436a-b598-00f6786d8649 tempest-VolumeRetypeWithoutMigrationTest-1415939065 None] Lock "cinder-19702cb7-39e6-4b81-9196-96f070d21f02-delete_volume" released by "delete_volume" :: held 4.548s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Flow 'volume_create_manager' (4b97013f-7cb6-42c7-8aed-1a3574a0ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb71f11-85bd-4a93-851f-6350ba69dcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb71f11-85bd-4a93-851f-6350ba69dcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-895919886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e7a3bb-cd26-4930-8f0f-1df42147e3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b3f38387bd45f7a77277ca9eac0ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:52Z,use_quota=True,user_id='ba16c8185f4846cd808cd55324401e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c21698a-1375-4963-a75b-c536c21ecf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c21698a-1375-4963-a75b-c536c21ecf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb2c5d8-be03-4a51-8946-727d735037fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb2c5d8-be03-4a51-8946-727d735037fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e7a3bb-cd26-4930-8f0f-1df42147e3ee', 'volume_name': 'volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0df206-4482-4f10-aa37-6706d6dc19b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0df206-4482-4f10-aa37-6706d6dc19b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d30449-cece-4562-9798-b5b55c93333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:51 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Volume 73e7a3bb-cd26-4930-8f0f-1df42147e3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee', 'volume_size': 1} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-895919886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e7a3bb-cd26-4930-8f0f-1df42147e3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b3f38387bd45f7a77277ca9eac0ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:52Z,use_quota=True,user_id='ba16c8185f4846cd808cd55324401e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Creating volume 73e7a3bb-cd26-4930-8f0f-1df42147e3ee {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:44:51 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:44:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:52 devstack sudo[86917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee 1073741824 Apr 29 16:44:52 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:53 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee 1073741824" returned: 0 in 1.034s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:53 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee Apr 29 16:44:53 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:54 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee" returned: 0 in 1.166s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:44:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d30449-cece-4562-9798-b5b55c93333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec846262-f2d0-4940-ab0f-d0aa0aa1ae75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:54 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Volume volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee (73e7a3bb-cd26-4930-8f0f-1df42147e3ee): created successfully Apr 29 16:44:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec846262-f2d0-4940-ab0f-d0aa0aa1ae75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Flow 'volume_create_manager' (4b97013f-7cb6-42c7-8aed-1a3574a0ef13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:44:54 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0a47fce7-c65b-41d9-8da3-687df4e9de8b tempest-ServersNegativeTestJSON-1341848763 None] Created volume successfully. Apr 29 16:44:56 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:44:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Flow 'volume_create_manager' (5d387bb9-bd00-4dc3-b2f0-9b1dbef66570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:44:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fe91df-557c-497f-bf4a-0e36276dcad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fe91df-557c-497f-bf4a-0e36276dcad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4999ebfd-dd1c-4db4-85e3-6c48aa01265d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b51c090a6d6462eb585410c6b2de0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:56Z,use_quota=True,user_id='e62724bdfb9c4c54b7f55d5fcafbbfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48099880-1892-4de0-b2f3-06a6792f2cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48099880-1892-4de0-b2f3-06a6792f2cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0332802-0a43-4ca7-9a2e-644b09202b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:56 devstack cinder-volume[84201]: DEBUG cinder.image.glance [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Creating Keystone auth plugin from conf {{(pid=84201) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 16:44:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0332802-0a43-4ca7-9a2e-644b09202b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4999ebfd-dd1c-4db4-85e3-6c48aa01265d', 'volume_name': 'volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d05d30a-888e-4871-a5a5-97d0697e31b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d05d30a-888e-4871-a5a5-97d0697e31b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d836dc0-c0e2-4e54-b353-769425a49e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:57 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Volume 4999ebfd-dd1c-4db4-85e3-6c48aa01265d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 16:44:57 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Trying to clone 4999ebfd-dd1c-4db4-85e3-6c48aa01265d from image 41e2d651-26b7-481d-97f0-de8b038b5cd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]). {{(pid=84201) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 16:44:57 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 16:44:57 devstack cinder-volume[84201]: INFO cinder.image.image_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Image download 20.69 MB at 20.69 MB/s Apr 29 16:44:57 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac01567c-d7e7-4abf-a8dc-346957658d48]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:44:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:57 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD Apr 29 16:44:57 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:58 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD" returned: 0 in 0.928s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:58 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Temporary image 41e2d651-26b7-481d-97f0-de8b038b5cd4 is fetched for user e62724bdfb9c4c54b7f55d5fcafbbfd8. {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 16:44:58 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c2cbcd-b8c8-4a94-806b-99a9cf48d357]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:44:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:58 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD Apr 29 16:44:58 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:44:59 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Flow 'volume_create_manager' (6ed5fc2f-6001-40b1-8571-88e66b8267a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4b6563-01ce-485b-85aa-691ca3d1ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD" returned: 0 in 0.943s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4999ebfd-dd1c-4db4-85e3-6c48aa01265d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b51c090a6d6462eb585410c6b2de0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:56Z,use_quota=True,user_id='e62724bdfb9c4c54b7f55d5fcafbbfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Creating volume 4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:44:59 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4b6563-01ce-485b-85aa-691ca3d1ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-794363076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c7e249-8b55-4164-acac-7c424021a893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b3f38387bd45f7a77277ca9eac0ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:59Z,use_quota=True,user_id='ba16c8185f4846cd808cd55324401e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:59 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d 1073741824 Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c9277f-9bc3-4990-8a2f-a06ec30498b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:59 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c9277f-9bc3-4990-8a2f-a06ec30498b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b37b70b-f8c1-4ade-ac96-0ea0835b4aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b37b70b-f8c1-4ade-ac96-0ea0835b4aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c7e249-8b55-4164-acac-7c424021a893', 'volume_name': 'volume-38c7e249-8b55-4164-acac-7c424021a893', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4676b0-3895-4716-be7e-66f5f3b18b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4676b0-3895-4716-be7e-66f5f3b18b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ade275-a8bf-48a5-9d12-1060405f1eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:44:59 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Volume 38c7e249-8b55-4164-acac-7c424021a893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c7e249-8b55-4164-acac-7c424021a893', 'volume_size': 1} Apr 29 16:44:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:00 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d 1073741824" returned: 0 in 1.107s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:00 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d Apr 29 16:45:00 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:01 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" returned: 0 in 0.663s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.695s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-794363076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c7e249-8b55-4164-acac-7c424021a893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b3f38387bd45f7a77277ca9eac0ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:44:59Z,use_quota=True,user_id='ba16c8185f4846cd808cd55324401e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Creating volume 38c7e249-8b55-4164-acac-7c424021a893 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:45:01 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:01 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893 1073741824 Apr 29 16:45:01 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Attempting download of 41e2d651-26b7-481d-97f0-de8b038b5cd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}])) to volume 4999ebfd-dd1c-4db4-85e3-6c48aa01265d. {{(pid=84201) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[634e1727-bbc8-4841-a74e-6d369e6afd75]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_llnp3c__ {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:01 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_llnp3c__ Apr 29 16:45:01 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:02 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_llnp3c__" returned: 0 in 0.885s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_llnp3c__ {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:02 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893 1073741824" returned: 0 in 1.124s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:02 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_llnp3c__ Apr 29 16:45:02 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:02 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893 Apr 29 16:45:02 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:03 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_llnp3c__" returned: 1 in 0.857s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_llnp3c__' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aaa6ee-ed20-4e2f-90c5-3475fac30296]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:03 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893" returned: 0 in 0.836s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ade275-a8bf-48a5-9d12-1060405f1eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c7e249-8b55-4164-acac-7c424021a893', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90594aa-97c0-4770-893a-348889f77185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:03 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Volume volume-38c7e249-8b55-4164-acac-7c424021a893 (38c7e249-8b55-4164-acac-7c424021a893): created successfully Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90594aa-97c0-4770-893a-348889f77185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:03 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD Apr 29 16:45:03 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Flow 'volume_create_manager' (6ed5fc2f-6001-40b1-8571-88e66b8267a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-41858ff7-d63c-4225-ab5d-d6bc49a5004e tempest-ServersNegativeTestJSON-1341848763 None] Created volume successfully. Apr 29 16:45:04 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD" returned: 0 in 0.863s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] 41e2d651-26b7-481d-97f0-de8b038b5cd4 was qcow2, converting to raw {{(pid=84201) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:04 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d Apr 29 16:45:04 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "cinder-38c7e249-8b55-4164-acac-7c424021a893-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Lock "cinder-38c7e249-8b55-4164-acac-7c424021a893-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "cinder-quobyte-38c7e249-8b55-4164-acac-7c424021a893" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Lock "cinder-quobyte-38c7e249-8b55-4164-acac-7c424021a893" acquired by "delete_volume" :: waited 0.035s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d2d055-4d3d-4769-86e7-d90e100c7a82]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:04 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893 Apr 29 16:45:04 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:04 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:45:04 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:05 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893" returned: 0 in 1.073s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:05 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.908s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:45:05 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893 Apr 29 16:45:05 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:06 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38c7e249-8b55-4164-acac-7c424021a893" returned: 0 in 1.083s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Lock "cinder-quobyte-38c7e249-8b55-4164-acac-7c424021a893" released by "delete_volume" :: held 2.222s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Created reservations ['92dd1097-be42-410f-8588-e21c01e9e7b5', 'c1aa4619-dca4-42c3-9dd9-0f44a4dc2c90', 'eb7b9282-2610-4aaf-9ec3-225d6aea450b', '879468c7-524a-41fe-af20-af2b4a0eaf8c'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:06 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:45:06 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:06 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" returned: 0 in 2.791s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4__zcy5ko1devstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:45:06 devstack cinder-volume[84201]: INFO cinder.image.image_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Converted 112.00 MB image at 40.10 MB/s Apr 29 16:45:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:07 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d 1G Apr 29 16:45:07 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "cinder-73e7a3bb-cd26-4930-8f0f-1df42147e3ee-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Lock "cinder-73e7a3bb-cd26-4930-8f0f-1df42147e3ee-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "cinder-quobyte-73e7a3bb-cd26-4930-8f0f-1df42147e3ee" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Lock "cinder-quobyte-73e7a3bb-cd26-4930-8f0f-1df42147e3ee" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:08 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d 1G" returned: 0 in 1.167s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:08 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d71b5a1-4793-4a89-91ca-d1c09e26dbdc]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.232s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:45:08 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Deleted volume successfully. Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[034f68f7-f01d-4170-9d7f-b4efbcae985d]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9c032db4-21b5-4076-91ab-e8aa9d425529 tempest-ServersNegativeTestJSON-1341848763 None] Lock "cinder-38c7e249-8b55-4164-acac-7c424021a893-delete_volume" released by "delete_volume" :: held 3.785s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:08 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee Apr 29 16:45:08 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:08 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d Apr 29 16:45:08 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:09 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee" returned: 0 in 1.210s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:09 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee Apr 29 16:45:09 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:09 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" returned: 0 in 1.262s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:09 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d Apr 29 16:45:09 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Flow 'volume_create_manager' (919abaac-fb24-4737-9be6-a7429632454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad37921-09ba-4e2f-a067-812406716fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad37921-09ba-4e2f-a067-812406716fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-216114480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20183e70-6e16-4dc0-8cbc-6409275d6456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05d5aaae2d641b097c3db10df7ea22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:45:10Z,use_quota=True,user_id='5c8fb575ef5e4d71b94e0d9c20ed2fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f193dd4-3a77-4628-8fce-abb5833e34c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f193dd4-3a77-4628-8fce-abb5833e34c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8be0a19-da73-4a83-9337-fc617fe7cb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8be0a19-da73-4a83-9337-fc617fe7cb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20183e70-6e16-4dc0-8cbc-6409275d6456', 'volume_name': 'volume-20183e70-6e16-4dc0-8cbc-6409275d6456', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffc8a3e-8577-49d2-9b7a-a83a405c90df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffc8a3e-8577-49d2-9b7a-a83a405c90df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced334f4-e271-43f2-9dd9-ae3b0be3ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:09 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Volume 20183e70-6e16-4dc0-8cbc-6409275d6456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20183e70-6e16-4dc0-8cbc-6409275d6456', 'volume_size': 1} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-216114480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20183e70-6e16-4dc0-8cbc-6409275d6456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05d5aaae2d641b097c3db10df7ea22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:45:10Z,use_quota=True,user_id='5c8fb575ef5e4d71b94e0d9c20ed2fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Creating volume 20183e70-6e16-4dc0-8cbc-6409275d6456 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:45:10 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:10 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456 1073741824 Apr 29 16:45:10 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:10 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-73e7a3bb-cd26-4930-8f0f-1df42147e3ee" returned: 0 in 0.791s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Lock "cinder-quobyte-73e7a3bb-cd26-4930-8f0f-1df42147e3ee" released by "delete_volume" :: held 2.063s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Created reservations ['6bbf4493-e40e-48cc-8da0-6ccdb88ab55c', '82feb379-4745-4918-a1a4-ebb2fac05241', '933f9ad2-1401-4956-a6df-a525afca5d58', '87d62d94-a3b1-4ee1-8035-00a570226a1e'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:10 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" returned: 1 in 0.900s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Downloaded image 41e2d651-26b7-481d-97f0-de8b038b5cd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}])) to volume 4999ebfd-dd1c-4db4-85e3-6c48aa01265d successfully. {{(pid=84201) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 16:45:10 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:45:10 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Temporary image 41e2d651-26b7-481d-97f0-de8b038b5cd4 for user e62724bdfb9c4c54b7f55d5fcafbbfd8 is deleted. {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Marking volume 4999ebfd-dd1c-4db4-85e3-6c48aa01265d as bootable. {{(pid=84201) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Copying metadata from image 41e2d651-26b7-481d-97f0-de8b038b5cd4 to 4999ebfd-dd1c-4db4-85e3-6c48aa01265d. {{(pid=84201) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Creating volume glance metadata for volume 4999ebfd-dd1c-4db4-85e3-6c48aa01265d backed by image 41e2d651-26b7-481d-97f0-de8b038b5cd4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84201) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d836dc0-c0e2-4e54-b353-769425a49e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12185b72-5853-4fe7-b536-555f5c0c2fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:10 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Volume volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d (4999ebfd-dd1c-4db4-85e3-6c48aa01265d): created successfully Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12185b72-5853-4fe7-b536-555f5c0c2fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Flow 'volume_create_manager' (5d387bb9-bd00-4dc3-b2f0-9b1dbef66570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:10 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-cbde7406-caf4-4a5f-84f0-a1923829139e tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Created volume successfully. Apr 29 16:45:11 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456 1073741824" returned: 0 in 1.009s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:11 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.686s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:45:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Deleted volume successfully. Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3325ef44-7950-47a8-b5de-3b663939c5a9 tempest-ServersNegativeTestJSON-1341848763 None] Lock "cinder-73e7a3bb-cd26-4930-8f0f-1df42147e3ee-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:11 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456 Apr 29 16:45:11 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:11 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456" returned: 0 in 0.686s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced334f4-e271-43f2-9dd9-ae3b0be3ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20183e70-6e16-4dc0-8cbc-6409275d6456', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadc0bca-e499-4436-a907-36991989a593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:11 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Volume volume-20183e70-6e16-4dc0-8cbc-6409275d6456 (20183e70-6e16-4dc0-8cbc-6409275d6456): created successfully Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadc0bca-e499-4436-a907-36991989a593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Flow 'volume_create_manager' (919abaac-fb24-4737-9be6-a7429632454e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-db5e9f10-57af-4b1f-8c32-197c3cc14ad1 tempest-VolumesMetadataTest-970318714 None] Created volume successfully. Apr 29 16:45:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:12 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e477207-af65-4002-a8d7-36eaa40122f1]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:12 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d Apr 29 16:45:12 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Acquiring lock "cinder-20183e70-6e16-4dc0-8cbc-6409275d6456-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Lock "cinder-20183e70-6e16-4dc0-8cbc-6409275d6456-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Acquiring lock "cinder-quobyte-20183e70-6e16-4dc0-8cbc-6409275d6456" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Lock "cinder-quobyte-20183e70-6e16-4dc0-8cbc-6409275d6456" acquired by "delete_volume" :: waited 0.034s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:13 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c18dc1-59ec-4732-8db5-de96e20caf1a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:13 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456 Apr 29 16:45:13 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:13 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" returned: 0 in 1.357s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:14 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d Apr 29 16:45:14 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:14 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456" returned: 0 in 1.079s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:14 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456 Apr 29 16:45:14 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:14 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" returned: 1 in 1.041s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:45:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.448s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53', 'name': 'volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abf99329-28ff-466c-94c8-7730e9c1ce69', 'enforce_multipath': True} {{(pid=84201) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 16:45:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-275f8e71-2682-4e92-96cc-62094e3d1265 req-ca369d47-566b-4d99-9ff9-5af3646705d8 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] attachment_update completed successfully. Apr 29 16:45:15 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20183e70-6e16-4dc0-8cbc-6409275d6456" returned: 0 in 1.149s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Lock "cinder-quobyte-20183e70-6e16-4dc0-8cbc-6409275d6456" released by "delete_volume" :: held 2.338s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Created reservations ['8982ef85-bcf3-4a97-8201-a8b346630a3a', '73a230a2-f935-4f9a-ba83-7bb7971957dc', '627e02a5-3638-4de7-8f07-ee598dbda3c5', '19b0f993-4736-49f6-9575-b2b82e552fd7'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:15 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:45:15 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:16 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.982s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:16 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:45:16 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Deleted volume successfully. Apr 29 16:45:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b308ac6d-f41b-4362-9001-ab105a631522 tempest-VolumesMetadataTest-970318714 None] Lock "cinder-20183e70-6e16-4dc0-8cbc-6409275d6456-delete_volume" released by "delete_volume" :: held 3.742s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:25 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=67,cinder:SELECT=58,cinder:INSERT=22,cinder:DELETE=5 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=56,cinder:UPDATE=65,cinder:INSERT=17,cinder:DELETE=6 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Flow 'volume_create_manager' (2491d9e0-5442-4a40-9a2a-fe098828c6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a03dd44-d594-41c8-aefa-162a09abbf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a03dd44-d594-41c8-aefa-162a09abbf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1826957725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2571f6-fb35-4832-9436-11689cfaceff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3f2cfda14e430e83f21fb8d7b9fe27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:45:27Z,use_quota=True,user_id='18a5eb9c29b94fe4b082945517d0e649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c75aa0a-d728-4963-be33-b914ee873c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c75aa0a-d728-4963-be33-b914ee873c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3df9ce-5346-472d-a93f-61ce40a5bcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3df9ce-5346-472d-a93f-61ce40a5bcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2571f6-fb35-4832-9436-11689cfaceff', 'volume_name': 'volume-5a2571f6-fb35-4832-9436-11689cfaceff', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f35591f-9d14-44fe-b2bd-1aaf1b33f573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f35591f-9d14-44fe-b2bd-1aaf1b33f573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bbac8d-f69b-4050-8d20-beb59071a14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:26 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Volume 5a2571f6-fb35-4832-9436-11689cfaceff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2571f6-fb35-4832-9436-11689cfaceff', 'volume_size': 1} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1826957725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2571f6-fb35-4832-9436-11689cfaceff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3f2cfda14e430e83f21fb8d7b9fe27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:45:27Z,use_quota=True,user_id='18a5eb9c29b94fe4b082945517d0e649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Creating volume 5a2571f6-fb35-4832-9436-11689cfaceff {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:45:26 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:45:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:26 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff 1073741824 Apr 29 16:45:26 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:27 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff 1073741824" returned: 0 in 1.020s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:27 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff Apr 29 16:45:27 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:29 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff" returned: 0 in 1.429s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] <== create_volume: return (2520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:45:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.524s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bbac8d-f69b-4050-8d20-beb59071a14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2571f6-fb35-4832-9436-11689cfaceff', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff991531-96bf-43cc-92ed-f25c12b900df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:29 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Volume volume-5a2571f6-fb35-4832-9436-11689cfaceff (5a2571f6-fb35-4832-9436-11689cfaceff): created successfully Apr 29 16:45:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff991531-96bf-43cc-92ed-f25c12b900df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Flow 'volume_create_manager' (2491d9e0-5442-4a40-9a2a-fe098828c6d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:29 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8d18d377-40b2-4afb-8e06-11a33820ebce tempest-VolumesTransfersV357Test-868691690 None] Created volume successfully. Apr 29 16:45:31 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7f0bc417-b557-4632-acc3-0c66d288355c tempest-VolumesTransfersV357Test-996791576 None] Transfer volume completed successfully. Apr 29 16:45:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Acquiring lock "cinder-5a2571f6-fb35-4832-9436-11689cfaceff-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Lock "cinder-5a2571f6-fb35-4832-9436-11689cfaceff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Acquiring lock "cinder-quobyte-5a2571f6-fb35-4832-9436-11689cfaceff" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Lock "cinder-quobyte-5a2571f6-fb35-4832-9436-11689cfaceff" acquired by "delete_volume" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:33 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75612db-0203-4de4-a2fb-cc968500f963]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:33 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff Apr 29 16:45:33 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:34 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff" returned: 0 in 0.991s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:34 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff Apr 29 16:45:34 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Flow 'volume_create_manager' (46420d7b-977a-4bbd-943a-c7a62104affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd4be8b-6ec1-470f-9973-10174b8393e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd4be8b-6ec1-470f-9973-10174b8393e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-266925266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6187d214-045b-4edd-a25f-760b38f8b86b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1082fa46452447ea9e7691a0409c8a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:45:35Z,use_quota=True,user_id='e76ebb1cecb141f5a1e31f26629e5eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded807ff-f774-482c-954a-da3d14fc0dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded807ff-f774-482c-954a-da3d14fc0dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fff412-0f49-485d-b116-2358d849453c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fff412-0f49-485d-b116-2358d849453c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6187d214-045b-4edd-a25f-760b38f8b86b', 'volume_name': 'volume-6187d214-045b-4edd-a25f-760b38f8b86b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147cb583-6da5-4d33-9087-8498675e12c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147cb583-6da5-4d33-9087-8498675e12c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d1548d-402e-4fa7-a9cc-9782b1d0230c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:34 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Volume 6187d214-045b-4edd-a25f-760b38f8b86b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6187d214-045b-4edd-a25f-760b38f8b86b', 'volume_size': 1} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-266925266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6187d214-045b-4edd-a25f-760b38f8b86b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1082fa46452447ea9e7691a0409c8a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:45:35Z,use_quota=True,user_id='e76ebb1cecb141f5a1e31f26629e5eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Creating volume 6187d214-045b-4edd-a25f-760b38f8b86b {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:45:34 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:45:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:34 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b 1073741824 Apr 29 16:45:34 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:35 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5a2571f6-fb35-4832-9436-11689cfaceff" returned: 0 in 0.861s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Lock "cinder-quobyte-5a2571f6-fb35-4832-9436-11689cfaceff" released by "delete_volume" :: held 1.924s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:35 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Created reservations ['dbf622ab-f088-4cc1-95b3-53db11b27260', '6555cf4b-7c1e-4fcb-9cd8-c7ddaf50f91b', '93c9f573-aef0-4d00-aa67-16fe6e18df17', '6c5a1e33-b947-491a-8a22-5348ca0fa458'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:45:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:35 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:45:35 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:36 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b 1073741824" returned: 0 in 1.095s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:36 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b Apr 29 16:45:36 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Flow 'volume_create_manager' (538a70fe-5b6b-46ba-b0fe-e007cfe9caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d77862-fa43-4eaa-9eb9-467ecb8b010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:36 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d77862-fa43-4eaa-9eb9-467ecb8b010c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-378055524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858b5599-5e2e-490d-afb8-3aa19df17ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3f2cfda14e430e83f21fb8d7b9fe27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:45:36Z,use_quota=True,user_id='18a5eb9c29b94fe4b082945517d0e649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeba8c2c-052a-4c2e-a3f7-5905f8f69513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeba8c2c-052a-4c2e-a3f7-5905f8f69513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d914dab-742f-4719-a8b3-506bb3969440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d914dab-742f-4719-a8b3-506bb3969440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '858b5599-5e2e-490d-afb8-3aa19df17ffe', 'volume_name': 'volume-858b5599-5e2e-490d-afb8-3aa19df17ffe', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79f1168-7b2e-4a88-b3b5-516f1269a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79f1168-7b2e-4a88-b3b5-516f1269a943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dada6797-5a2e-42cc-a829-4e06828f3a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:36 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Volume 858b5599-5e2e-490d-afb8-3aa19df17ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-858b5599-5e2e-490d-afb8-3aa19df17ffe', 'volume_size': 1} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.913s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:45:36 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Deleted volume successfully. Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-58bd2ad8-6a63-4df2-8200-e94b83e8395b tempest-VolumesTransfersV357Test-1038129424 None] Lock "cinder-5a2571f6-fb35-4832-9436-11689cfaceff-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:36 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b" returned: 0 in 0.741s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-378055524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858b5599-5e2e-490d-afb8-3aa19df17ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3f2cfda14e430e83f21fb8d7b9fe27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:45:36Z,use_quota=True,user_id='18a5eb9c29b94fe4b082945517d0e649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Creating volume 858b5599-5e2e-490d-afb8-3aa19df17ffe {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:45:36 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d1548d-402e-4fa7-a9cc-9782b1d0230c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6187d214-045b-4edd-a25f-760b38f8b86b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f919c1a0-a184-4411-b37c-342d88dcd9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:36 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe 1073741824 Apr 29 16:45:36 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:36 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Volume volume-6187d214-045b-4edd-a25f-760b38f8b86b (6187d214-045b-4edd-a25f-760b38f8b86b): created successfully Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f919c1a0-a184-4411-b37c-342d88dcd9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Flow 'volume_create_manager' (46420d7b-977a-4bbd-943a-c7a62104affa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:36 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-da91eb4e-a88c-4ae5-abeb-fc3ebd834205 req-d2089d03-ee60-4aa3-8498-20623a023c96 tempest-VolumesGetTestJSON-590405899 None] Created volume successfully. Apr 29 16:45:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Acquiring lock "cinder-6187d214-045b-4edd-a25f-760b38f8b86b-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Lock "cinder-6187d214-045b-4edd-a25f-760b38f8b86b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Acquiring lock "cinder-quobyte-6187d214-045b-4edd-a25f-760b38f8b86b" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Lock "cinder-quobyte-6187d214-045b-4edd-a25f-760b38f8b86b" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:37 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dba8734-04de-4f3e-8ad5-12201f80ecb2]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:37 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b Apr 29 16:45:37 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:37 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe 1073741824" returned: 0 in 0.969s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:37 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe Apr 29 16:45:37 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:38 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b" returned: 0 in 1.423s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:38 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:38 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b Apr 29 16:45:38 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe" returned: 0 in 1.032s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:45:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dada6797-5a2e-42cc-a829-4e06828f3a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858b5599-5e2e-490d-afb8-3aa19df17ffe', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fb8197-8cf4-426c-81f7-465effff1f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:39 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Volume volume-858b5599-5e2e-490d-afb8-3aa19df17ffe (858b5599-5e2e-490d-afb8-3aa19df17ffe): created successfully Apr 29 16:45:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fb8197-8cf4-426c-81f7-465effff1f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Flow 'volume_create_manager' (538a70fe-5b6b-46ba-b0fe-e007cfe9caaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:39 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ad5aa0df-a970-4516-a668-6a7d045948f2 tempest-VolumesTransfersV357Test-868691690 None] Created volume successfully. Apr 29 16:45:40 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6187d214-045b-4edd-a25f-760b38f8b86b" returned: 0 in 1.857s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Lock "cinder-quobyte-6187d214-045b-4edd-a25f-760b38f8b86b" released by "delete_volume" :: held 3.399s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:40 devstack cinder-volume[84201]: DEBUG cinder.quota [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Created reservations ['886ef2e6-3477-4822-8241-a794ee419cb5', '54357a46-cfaf-42c1-bbad-8fe8ab535900', '75923a85-7a58-4381-a492-0355bd3d20ec', 'dffca553-96f3-4f2f-8214-714df638263e'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Acquiring lock "cinder-858b5599-5e2e-490d-afb8-3aa19df17ffe-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Lock "cinder-858b5599-5e2e-490d-afb8-3aa19df17ffe-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Acquiring lock "cinder-quobyte-858b5599-5e2e-490d-afb8-3aa19df17ffe" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:45:41 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:45:41 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Lock "cinder-quobyte-858b5599-5e2e-490d-afb8-3aa19df17ffe" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[638c1a3a-a825-45a8-9b2d-8754fad23f7d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:45:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:41 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe Apr 29 16:45:41 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:43 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.817s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:43 devstack cinder-volume[84201]: DEBUG cinder.manager [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:45:43 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Deleted volume successfully. Apr 29 16:45:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7b0e58a7-4af8-45eb-a442-4a18a210d7eb req-400325b4-41bf-4ecf-a9c0-e53cfdec7382 tempest-VolumesGetTestJSON-590405899 None] Lock "cinder-6187d214-045b-4edd-a25f-760b38f8b86b-delete_volume" released by "delete_volume" :: held 5.889s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:43 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe" returned: 0 in 2.050s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:43 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe Apr 29 16:45:43 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:45 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-858b5599-5e2e-490d-afb8-3aa19df17ffe" returned: 0 in 1.480s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Lock "cinder-quobyte-858b5599-5e2e-490d-afb8-3aa19df17ffe" released by "delete_volume" :: held 3.622s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:45 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Created reservations ['cbadabb1-dc83-4e7f-a4b0-8b85b6d34e47', '5fe2d482-6306-4fba-9d1c-4b2fe4fc9fd2', '099a4cf9-06e9-4940-9c88-76dff365a009', 'a7cda0e0-2adc-4f26-91f8-932871be37f6'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:45:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:45 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:45:45 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:45:46 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 29 16:45:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.510s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:45:46 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:45:46 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Deleted volume successfully. Apr 29 16:45:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d25e4b47-ec05-483a-8120-e73f1c1c24b8 tempest-VolumesTransfersV357Test-1038129424 None] Lock "cinder-858b5599-5e2e-490d-afb8-3aa19df17ffe-delete_volume" released by "delete_volume" :: held 5.818s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:45:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2f782c48-8828-47a8-9a49-e4464345c727 tempest-BackendsCapabilitiesAdminTestsJSON-1954763124 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5835723876953, 'free_capacity_gb': 1775.5835723876953, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84201) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 16:45:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b9e0b363-9286-4985-aa6e-c33e53795799 tempest-BackendsCapabilitiesAdminTestsJSON-1954763124 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5835723876953, 'free_capacity_gb': 1775.5835723876953, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84201) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 16:45:55 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=36,cinder:SELECT=17,cinder:INSERT=8,cinder:DELETE=3 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:45:56 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=26,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=3 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:45:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-21c15292-4033-4996-9856-da39a74f5e9c tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Terminate volume connection completed successfully. Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-21c15292-4033-4996-9856-da39a74f5e9c tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Deleting attachment abf99329-28ff-466c-94c8-7730e9c1ce69. {{(pid=84201) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Flow 'volume_create_manager' (86fff89b-e001-4269-8c86-5352c5a75e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a66bdb9-b56a-48c0-ac27-d296cf336f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a66bdb9-b56a-48c0-ac27-d296cf336f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2091614836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3fc0a9-2044-4e30-bd2f-7aec8972cc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b30718583544c4a25ca8da8eef43b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:00Z,use_quota=True,user_id='d24b75f8d5624f7ca36bef0cec2bc96c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e4b4c6-7831-4374-9827-a86e253ca4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e4b4c6-7831-4374-9827-a86e253ca4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447cac89-0963-4f61-be1b-5a2cb4f4d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447cac89-0963-4f61-be1b-5a2cb4f4d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e3fc0a9-2044-4e30-bd2f-7aec8972cc71', 'volume_name': 'volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2aa73c-47c8-4c91-ad74-23ce98013dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2aa73c-47c8-4c91-ad74-23ce98013dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2a82c8-1a69-4dbd-a58c-92d8c3beadd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:45:59 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Volume 1e3fc0a9-2044-4e30-bd2f-7aec8972cc71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71', 'volume_size': 1} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2091614836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3fc0a9-2044-4e30-bd2f-7aec8972cc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b30718583544c4a25ca8da8eef43b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:00Z,use_quota=True,user_id='d24b75f8d5624f7ca36bef0cec2bc96c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Creating volume 1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:45:59 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:45:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:45:59 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 1073741824 Apr 29 16:45:59 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "cinder-4999ebfd-dd1c-4db4-85e3-6c48aa01265d-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "cinder-4999ebfd-dd1c-4db4-85e3-6c48aa01265d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "cinder-quobyte-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "cinder-quobyte-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" acquired by "delete_volume" :: waited 0.035s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:00 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b4a63d-079d-4b35-8e9d-3ff3516eb0f0]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:00 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d Apr 29 16:46:00 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:00 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:46:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Flow 'volume_create_manager' (ec924426-d138-489b-93a6-7cb100639f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15db1c28-5cfb-4f82-bffc-e656668f77d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15db1c28-5cfb-4f82-bffc-e656668f77d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-996749364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe00fc30caf44dba3dd99423dcc09d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:01Z,use_quota=True,user_id='e3c09e1365e543179d39c2096530bcb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7ef8f1-29f3-4da9-a1a5-6076dcf4ab7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7ef8f1-29f3-4da9-a1a5-6076dcf4ab7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1abd1d5-2448-4bba-ba5f-2ba8ed47279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1abd1d5-2448-4bba-ba5f-2ba8ed47279a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d', 'volume_name': 'volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45192d96-f0fd-49e0-9044-2a8feecbb04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45192d96-f0fd-49e0-9044-2a8feecbb04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859ae832-472e-45c0-b983-383ca9d7803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:01 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Volume 1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d', 'volume_size': 1} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:01 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" returned: 0 in 1.106s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:01 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 1073741824" returned: 0 in 1.677s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:01 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 Apr 29 16:46:01 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:01 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d Apr 29 16:46:01 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:02 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" returned: 1 in 0.886s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:02 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71" returned: 0 in 0.830s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] <== create_volume: return (2587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.590s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:02 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d Apr 29 16:46:02 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.335s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-996749364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe00fc30caf44dba3dd99423dcc09d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:01Z,use_quota=True,user_id='e3c09e1365e543179d39c2096530bcb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Creating volume 1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:46:02 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2a82c8-1a69-4dbd-a58c-92d8c3beadd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:02 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d 1073741824 Apr 29 16:46:02 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f55fe70-5d9e-4ac2-be9b-490ae181a9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:02 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Volume volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 (1e3fc0a9-2044-4e30-bd2f-7aec8972cc71): created successfully Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f55fe70-5d9e-4ac2-be9b-490ae181a9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Flow 'volume_create_manager' (86fff89b-e001-4269-8c86-5352c5a75e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:02 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-a3b18508-855e-40d1-9cbf-6920479d42c0 tempest-ServerRescueNegativeTestJSON-48590134 None] Created volume successfully. Apr 29 16:46:03 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" returned: 0 in 1.124s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "cinder-quobyte-4999ebfd-dd1c-4db4-85e3-6c48aa01265d" released by "delete_volume" :: held 3.252s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:03 devstack cinder-volume[84201]: DEBUG cinder.quota [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Created reservations ['5178e1d8-1873-44ca-bfef-4504dc2e9107', '61455c2c-0ae8-4986-9e72-2b017df7ac7c', '4cd02cf2-5a16-423d-8fec-f1119c75644f', 'eb744a87-639c-47a8-9779-ecfea1496545'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:46:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:03 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:46:03 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:04 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d 1073741824" returned: 0 in 1.771s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:04 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d Apr 29 16:46:04 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:46:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:04 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:46:04 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:06 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 2.299s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG cinder.manager [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:46:06 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Deleted volume successfully. Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-6dfea17c-b11b-4d2f-94f8-2851a484a5eb req-01778afa-5549-425d-8519-bf244958de34 tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "cinder-4999ebfd-dd1c-4db4-85e3-6c48aa01265d-delete_volume" released by "delete_volume" :: held 6.084s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:06 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" returned: 0 in 1.930s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] <== create_volume: return (3832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.849s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859ae832-472e-45c0-b983-383ca9d7803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ffaa43-8a40-4539-ac2c-22c19dfddaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:06 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Volume volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d (1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d): created successfully Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ffaa43-8a40-4539-ac2c-22c19dfddaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Flow 'volume_create_manager' (ec924426-d138-489b-93a6-7cb100639f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:06 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-4f6eb91b-9f88-4f7e-814b-657f5683670c tempest-VolumesCloneTest-161294645 None] Created volume successfully. Apr 29 16:46:06 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 2.140s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:06 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Flow 'volume_create_manager' (b19f2d6d-8278-48c4-bcaf-93411d0a46d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0044cec-0988-40f3-aa37-f5c81c6947e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0044cec-0988-40f3-aa37-f5c81c6947e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1344392808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c905332-8ff8-405a-a71e-2c77780c4b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe00fc30caf44dba3dd99423dcc09d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:08Z,use_quota=True,user_id='e3c09e1365e543179d39c2096530bcb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c47429e-87be-4050-91c3-0f4487697899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c47429e-87be-4050-91c3-0f4487697899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8704e1ba-a06d-4359-94be-701f6b31ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8704e1ba-a06d-4359-94be-701f6b31ad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7c905332-8ff8-405a-a71e-2c77780c4b81', 'volume_name': 'volume-7c905332-8ff8-405a-a71e-2c77780c4b81', 'volume_size': 2, 'source_volid': '1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d', 'source_volstatus': 'available'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bc8cbf-cc1a-4e8b-9314-8ddcba75a95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bc8cbf-cc1a-4e8b-9314-8ddcba75a95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d10f70-7d3f-4285-a34f-ff7662edd1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:08 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Volume 7c905332-8ff8-405a-a71e-2c77780c4b81: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7c905332-8ff8-405a-a71e-2c77780c4b81', 'volume_size': 2, 'source_volid': '1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d', 'source_volstatus': 'available'} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:08 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Cloning volume 1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d to volume 7c905332-8ff8-405a-a71e-2c77780c4b81 Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Creating offline snapshot f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd of volume 1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f824a2b3-bf6f-41af-a7b7-38fce5b273d0]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:08 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d Apr 29 16:46:08 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:10 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" returned: 0 in 1.751s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:10 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd 1G Apr 29 16:46:10 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:11 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd 1G" returned: 0 in 1.509s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:11 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd Apr 29 16:46:11 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:12 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd" returned: 0 in 0.809s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:12 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd is being set with open permissions: ugo+rw Apr 29 16:46:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:12 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd Apr 29 16:46:12 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:13 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd" returned: 0 in 0.681s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:13 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.info Apr 29 16:46:13 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:13 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.info" returned: 0 in 0.641s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:13 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.info is being set with open permissions: ugo+rw Apr 29 16:46:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:13 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.info Apr 29 16:46:13 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:14 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.info" returned: 0 in 0.610s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Acquiring lock "cinder-quobyte-7c905332-8ff8-405a-a71e-2c77780c4b81" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Lock "cinder-quobyte-7c905332-8ff8-405a-a71e-2c77780c4b81" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] snapshot: f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd, volume: 7c905332-8ff8-405a-a71e-2c77780c4b81, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e1341d-9856-430f-9c9f-fc4c2dbe39aa]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:14 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd Apr 29 16:46:14 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:15 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd" returned: 0 in 1.257s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:46:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:46:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:46:15 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b070760-6e15-4eec-8f2c-adba6c693d5d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:16 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d Apr 29 16:46:16 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:16 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" returned: 0 in 0.866s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:16 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:46:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:16 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 Apr 29 16:46:16 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:23 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:46:23 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:46:24 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-a23aed06-3702-4389-9e1a-76743b7ec88c tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Terminate volume connection completed successfully. Apr 29 16:46:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-a23aed06-3702-4389-9e1a-76743b7ec88c tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Deleting attachment 83ae6647-7a13-435f-8536-6ed9dbeee65e. {{(pid=84201) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 16:46:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "cinder-1551f051-1ec6-4ed1-8785-2c7a893175f2-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "cinder-1551f051-1ec6-4ed1-8785-2c7a893175f2-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "cinder-quobyte-1551f051-1ec6-4ed1-8785-2c7a893175f2" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "cinder-quobyte-1551f051-1ec6-4ed1-8785-2c7a893175f2" acquired by "delete_volume" :: waited 0.053s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:25 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9061c95d-95ff-472a-9122-dc262686c727]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:25 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 Apr 29 16:46:25 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:26 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2" returned: 0 in 1.547s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:26 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81" returned: 0 in 10.244s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:27 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2 Apr 29 16:46:27 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:27 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[50774603-aa2d-471b-8b74-480bdf5ac548]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:27 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d Apr 29 16:46:27 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:28 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1551f051-1ec6-4ed1-8785-2c7a893175f2" returned: 0 in 1.337s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "cinder-quobyte-1551f051-1ec6-4ed1-8785-2c7a893175f2" released by "delete_volume" :: held 2.976s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG cinder.quota [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Created reservations ['6f15aebc-d377-4de2-9958-259755c57bfb', 'ec514c3f-016f-4ac5-9ce2-ed1584127956', '2f02be35-c533-408d-b5e2-9aa36c023b0c', 'b3a7ec4c-0244-4989-a526-1d8623a29033'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:28 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:46:28 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:28 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" returned: 0 in 1.600s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d, size 1024.00 MB, duration 10.25 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:46:28 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Converted 1024.00 MB image at 99.91 MB/s Apr 29 16:46:28 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 is being set with open permissions: ugo+rw Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:28 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 Apr 29 16:46:28 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Acquiring lock "cinder-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "cinder-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Acquiring lock "cinder-quobyte-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "cinder-quobyte-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71" acquired by "delete_volume" :: waited 0.031s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:29 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fdf2e9-b26c-481b-8f97-06fd3bbdf592]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:29 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 Apr 29 16:46:29 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:30 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.707s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG cinder.manager [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:46:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Deleted volume successfully. Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-0aefc67f-eca4-46d5-9519-a8983e8f1c23 req-b9f809bb-2f1b-4951-b6f5-e24f8f52aaef tempest-ServerBootFromVolumeStableRescueTest-106166999 None] Lock "cinder-1551f051-1ec6-4ed1-8785-2c7a893175f2-delete_volume" released by "delete_volume" :: held 5.083s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:30 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:30 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71" returned: 0 in 1.370s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81" returned: 0 in 1.784s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Lock "cinder-quobyte-7c905332-8ff8-405a-a71e-2c77780c4b81" released by "_copy_volume_from_snapshot" :: held 15.892s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:30 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71 Apr 29 16:46:30 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Acquiring lock "cinder-quobyte-f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Lock "cinder-quobyte-f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Deleting offline snapshot f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd of volume 1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] snapshot_file for this snap is: volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e584700-3fa3-40e1-823d-31b3065f8e07]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:30 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd Apr 29 16:46:30 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:31 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71" returned: 0 in 1.210s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "cinder-quobyte-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71" released by "delete_volume" :: held 2.650s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Created reservations ['cb743399-2084-4cd2-8364-3c7cfbbb556d', '7750cd9b-8e95-460f-9775-dc1b9b6f8d0c', '9a85eb6f-8a3d-4124-9196-63a30a667554', '5e552c71-6a19-487b-84e8-e9643ea71c74'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:31 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd" returned: 0 in 1.384s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:46:31 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:46:31 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe392ca2-5881-41ab-8712-883959e31902]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:32 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d Apr 29 16:46:32 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:32 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.794s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:32 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:46:32 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Deleted volume successfully. Apr 29 16:46:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-884badc4-c87a-49db-a1a2-622fddd7d0bd tempest-ServerRescueNegativeTestJSON-48590134 None] Lock "cinder-1e3fc0a9-2044-4e30-bd2f-7aec8972cc71-delete_volume" released by "delete_volume" :: held 3.915s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:33 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" returned: 0 in 1.536s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:33 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd Apr 29 16:46:33 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:34 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd" returned: 0 in 1.164s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:34 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd Apr 29 16:46:34 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:35 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d.f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd" returned: 0 in 1.027s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Lock "cinder-quobyte-f2c70c74-ebd2-4bd5-98de-f0bd680c3ebd" released by "_delete_snapshot" :: held 5.291s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 27.624s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d10f70-7d3f-4285-a34f-ff7662edd1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c905332-8ff8-405a-a71e-2c77780c4b81', 'volume_size': 2, 'source_volid': '1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d', 'source_volstatus': 'available'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05eefeda-b373-4d2e-8e42-7a9059d560a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:35 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Volume volume-7c905332-8ff8-405a-a71e-2c77780c4b81 (7c905332-8ff8-405a-a71e-2c77780c4b81): created successfully Apr 29 16:46:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05eefeda-b373-4d2e-8e42-7a9059d560a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Flow 'volume_create_manager' (b19f2d6d-8278-48c4-bcaf-93411d0a46d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6286f564-db03-4cbf-ad14-3b5489d88505 tempest-VolumesCloneTest-161294645 None] Created volume successfully. Apr 29 16:46:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Acquiring lock "cinder-7c905332-8ff8-405a-a71e-2c77780c4b81-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Lock "cinder-7c905332-8ff8-405a-a71e-2c77780c4b81-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Acquiring lock "cinder-quobyte-7c905332-8ff8-405a-a71e-2c77780c4b81" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Lock "cinder-quobyte-7c905332-8ff8-405a-a71e-2c77780c4b81" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:37 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[88191953-ce5a-400a-8b6c-101773277cb9]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:37 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 Apr 29 16:46:37 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:38 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81" returned: 0 in 1.133s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:38 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81 Apr 29 16:46:38 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:39 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7c905332-8ff8-405a-a71e-2c77780c4b81" returned: 0 in 0.994s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Lock "cinder-quobyte-7c905332-8ff8-405a-a71e-2c77780c4b81" released by "delete_volume" :: held 2.207s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Flow 'volume_create_manager' (67c67eb7-f5a6-4565-ac8d-f4433eb359d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc92ddf9-e017-4619-86c4-8f659ad98c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc92ddf9-e017-4619-86c4-8f659ad98c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1795174327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef27572-481f-4f89-a782-614e589591e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a7eff2ac3d488f976c75c93afee462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:40Z,use_quota=True,user_id='99c4ae5369d64bda8def593eaffe079f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60e0554c-67f5-4618-a21d-949cb1126f03),volume_type_id=60e0554c-67f5-4618-a21d-949cb1126f03)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f02bfa-305b-4d7e-abe0-13b21caeee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f02bfa-305b-4d7e-abe0-13b21caeee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a300952e-1f3c-47a1-a5fe-a1e7388967ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a300952e-1f3c-47a1-a5fe-a1e7388967ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef27572-481f-4f89-a782-614e589591e8', 'volume_name': 'volume-0ef27572-481f-4f89-a782-614e589591e8', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f71719-e571-48bb-a815-3ed6f60ea44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f71719-e571-48bb-a815-3ed6f60ea44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91df659e-8377-4be9-a5a0-d9d3bec99366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:39 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Volume 0ef27572-481f-4f89-a782-614e589591e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef27572-481f-4f89-a782-614e589591e8', 'volume_size': 1} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1795174327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef27572-481f-4f89-a782-614e589591e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a7eff2ac3d488f976c75c93afee462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:40Z,use_quota=True,user_id='99c4ae5369d64bda8def593eaffe079f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60e0554c-67f5-4618-a21d-949cb1126f03),volume_type_id=60e0554c-67f5-4618-a21d-949cb1126f03)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Creating volume 0ef27572-481f-4f89-a782-614e589591e8 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:46:39 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Created reservations ['658642b6-65a1-466b-8633-ff7dad4f6bc9', '37090c4a-434e-437f-baa9-8d3b0d80d6d5', 'c922fb8a-ce7e-46d2-999a-decd2090e3aa', 'ac55aa24-a3cc-4884-b384-6284ba107047'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:46:39 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8 1073741824 Apr 29 16:46:39 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:39 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:46:39 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:40 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.759s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:40 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:46:40 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Deleted volume successfully. Apr 29 16:46:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc15744c-f17e-47e8-bff6-b2df4c2186ed tempest-VolumesCloneTest-161294645 None] Lock "cinder-7c905332-8ff8-405a-a71e-2c77780c4b81-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Acquiring lock "cinder-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Lock "cinder-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:40 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Acquiring lock "cinder-quobyte-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8 1073741824" returned: 0 in 1.288s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Lock "cinder-quobyte-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:41 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa38e0-0392-49b2-8675-0a8d5e8eb3f7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:41 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8 Apr 29 16:46:41 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:41 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d Apr 29 16:46:41 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:42 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8" returned: 0 in 0.986s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] <== create_volume: return (2346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91df659e-8377-4be9-a5a0-d9d3bec99366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef27572-481f-4f89-a782-614e589591e8', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76735a9-fe14-4150-b5d8-1ed7af3987d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:42 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Volume volume-0ef27572-481f-4f89-a782-614e589591e8 (0ef27572-481f-4f89-a782-614e589591e8): created successfully Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76735a9-fe14-4150-b5d8-1ed7af3987d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Flow 'volume_create_manager' (67c67eb7-f5a6-4565-ac8d-f4433eb359d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:42 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" returned: 0 in 1.098s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:42 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7351ca6b-d11c-4cc0-9ac9-70e3d0c729ab tempest-VolumeTypesAccessTest-1767367006 None] Created volume successfully. Apr 29 16:46:42 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d Apr 29 16:46:42 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:42 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" returned: 0 in 0.799s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Lock "cinder-quobyte-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d" released by "delete_volume" :: held 1.995s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Created reservations ['0d30b4f3-b50c-4993-adef-84665a61b01b', '993711d5-85e5-4a8d-8055-907f184fa94d', '957b62f4-1fa0-4e5b-95ca-237b8edf523f', '731be72f-65f2-435f-8339-1f664d659a56'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Acquiring lock "cinder-0ef27572-481f-4f89-a782-614e589591e8-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:43 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:46:43 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Lock "cinder-0ef27572-481f-4f89-a782-614e589591e8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Acquiring lock "cinder-quobyte-0ef27572-481f-4f89-a782-614e589591e8" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Lock "cinder-quobyte-0ef27572-481f-4f89-a782-614e589591e8" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0197ba5a-905b-4844-a835-66e0d4749107]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:43 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8 Apr 29 16:46:43 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:43 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.773s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:46:43 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Deleted volume successfully. Apr 29 16:46:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8ea2ccdd-08a8-4ce7-8578-d4e4ed757e21 tempest-VolumesCloneTest-161294645 None] Lock "cinder-1ffa7448-8ac5-4fe3-b5aa-3f62380b2e4d-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:44 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8" returned: 0 in 1.080s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:44 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8 Apr 29 16:46:44 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:45 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0ef27572-481f-4f89-a782-614e589591e8" returned: 0 in 0.775s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Lock "cinder-quobyte-0ef27572-481f-4f89-a782-614e589591e8" released by "delete_volume" :: held 1.914s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:45 devstack cinder-volume[84201]: WARNING cinder.quota [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-611649564 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-611649564, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:46:45 devstack cinder-volume[84201]: WARNING cinder.quota [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-611649564 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-611649564, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:46:45 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Created reservations ['03e474c8-4498-44e1-9976-1fabf854876f', 'bd34c6b5-1762-46be-b594-88904f600cd6', '958dbf5b-d3fc-446d-85ba-8e5e39f1c9f2', '97ad323a-2bc4-42d5-b76d-95fcc14f0ef7'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:46:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:45 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:46:45 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:46 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.740s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:46 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:46:46 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Deleted volume successfully. Apr 29 16:46:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9586251a-739f-42b5-af66-864c84ae16e3 tempest-VolumeTypesAccessTest-1767367006 None] Lock "cinder-0ef27572-481f-4f89-a782-614e589591e8-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (1d3a64fd-909d-4fd5-abda-999d8cf290b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086c6ab0-9954-4905-b8f1-97fe1113127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086c6ab0-9954-4905-b8f1-97fe1113127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-701324442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d16ad07-6966-47aa-af95-a57988cdc760,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:47Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b142da1-83ef-4e13-8d91-d57555746bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b142da1-83ef-4e13-8d91-d57555746bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81835197-3bbb-4abf-8973-bad1dd0c4be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81835197-3bbb-4abf-8973-bad1dd0c4be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d16ad07-6966-47aa-af95-a57988cdc760', 'volume_name': 'volume-4d16ad07-6966-47aa-af95-a57988cdc760', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a70d893-554c-498f-a919-7b41505a2065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a70d893-554c-498f-a919-7b41505a2065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e0ae64-95aa-4eb0-8d8d-b15d2cf0bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:47 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Volume 4d16ad07-6966-47aa-af95-a57988cdc760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d16ad07-6966-47aa-af95-a57988cdc760', 'volume_size': 1} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-701324442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d16ad07-6966-47aa-af95-a57988cdc760,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:47Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Creating volume 4d16ad07-6966-47aa-af95-a57988cdc760 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:46:47 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:46:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:47 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760 1073741824 Apr 29 16:46:47 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:48 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-fd88a9b8-c53c-417e-a42a-c2a019de3939 tempest-GroupSnapshotsV319Test-1012620345 None] Group tempest-GroupSnapshotsV319Test-Group-45307071: creating Apr 29 16:46:48 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-fd88a9b8-c53c-417e-a42a-c2a019de3939 tempest-GroupSnapshotsV319Test-1012620345 None] Group tempest-GroupSnapshotsV319Test-Group-45307071: created successfully Apr 29 16:46:48 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-fd88a9b8-c53c-417e-a42a-c2a019de3939 tempest-GroupSnapshotsV319Test-1012620345 None] Create group completed successfully. Apr 29 16:46:48 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760 1073741824" returned: 0 in 1.180s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:48 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760 Apr 29 16:46:48 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:49 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760" returned: 0 in 0.688s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:46:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e0ae64-95aa-4eb0-8d8d-b15d2cf0bd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d16ad07-6966-47aa-af95-a57988cdc760', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee88add-42f8-4fb5-9162-96cfe91b1f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:49 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Volume volume-4d16ad07-6966-47aa-af95-a57988cdc760 (4d16ad07-6966-47aa-af95-a57988cdc760): created successfully Apr 29 16:46:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee88add-42f8-4fb5-9162-96cfe91b1f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (1d3a64fd-909d-4fd5-abda-999d8cf290b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:49 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-53bc51d5-50da-49b4-96b1-bab5480b7414 tempest-VolumesGetTest-562840024 None] Created volume successfully. Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Flow 'volume_create_manager' (e1edd891-6fc7-4043-8e97-7e2bc7defd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfdc96d-fc08-499d-b33d-791b1babbe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfdc96d-fc08-499d-b33d-791b1babbe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407560266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d42cd50-c4b5-4189-a516-6ccecc7e26a5,host='devstack@QuobyteHD#QuobyteHD',id=45249ace-58bd-47ed-b971-f3bde152aeaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5ba14285694a4590604cd2b330e872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:50Z,use_quota=True,user_id='8544abd354bb4c28affd6953beddc097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dff0c38-2428-4c1d-8eb2-b3bba9bbb91f),volume_type_id=4dff0c38-2428-4c1d-8eb2-b3bba9bbb91f)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575593ee-e6c1-4f82-b0a4-b758b15c6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575593ee-e6c1-4f82-b0a4-b758b15c6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062c1ca8-610b-4630-8254-7f0f1970d5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062c1ca8-610b-4630-8254-7f0f1970d5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45249ace-58bd-47ed-b971-f3bde152aeaf', 'volume_name': 'volume-45249ace-58bd-47ed-b971-f3bde152aeaf', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2268ab6-40f5-4eed-a0c3-845ab8fa7569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2268ab6-40f5-4eed-a0c3-845ab8fa7569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62dd9e8-179b-4c99-a44a-7de9446515d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:50 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Volume 45249ace-58bd-47ed-b971-f3bde152aeaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45249ace-58bd-47ed-b971-f3bde152aeaf', 'volume_size': 1} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d42cd50-c4b5-4189-a516-6ccecc7e26a5,created_at=2026-04-29T14:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407560266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d42cd50-c4b5-4189-a516-6ccecc7e26a5,host='devstack@QuobyteHD#QuobyteHD',id=45249ace-58bd-47ed-b971-f3bde152aeaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5ba14285694a4590604cd2b330e872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:50Z,use_quota=True,user_id='8544abd354bb4c28affd6953beddc097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dff0c38-2428-4c1d-8eb2-b3bba9bbb91f),volume_type_id=4dff0c38-2428-4c1d-8eb2-b3bba9bbb91f)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Creating volume 45249ace-58bd-47ed-b971-f3bde152aeaf {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:46:50 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:46:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:50 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf 1073741824 Apr 29 16:46:50 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:51 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf 1073741824" returned: 0 in 1.033s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:51 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf Apr 29 16:46:51 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (4ffd23af-f809-402c-ba95-0b0398d00441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d502f1b3-45e3-4197-bf96-6e7d00ee5fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d502f1b3-45e3-4197-bf96-6e7d00ee5fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1288511175',display_name='tempest-VolumesGetTest-Volume-354525887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514de91d-dbe7-4b96-8656-024b63881110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:51Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc94203a-ce4d-4bc4-b235-618b47ef6b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc94203a-ce4d-4bc4-b235-618b47ef6b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9b03bf-5c3c-47c8-8d8c-5efdb18f0f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9b03bf-5c3c-47c8-8d8c-5efdb18f0f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514de91d-dbe7-4b96-8656-024b63881110', 'volume_name': 'volume-514de91d-dbe7-4b96-8656-024b63881110', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5387142-927d-402c-90e0-9e5e64bd12c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5387142-927d-402c-90e0-9e5e64bd12c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e2dc93-5ef3-4319-ad24-f0d636020419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:51 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Volume 514de91d-dbe7-4b96-8656-024b63881110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514de91d-dbe7-4b96-8656-024b63881110', 'volume_size': 1} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:51 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf" returned: 0 in 0.721s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1288511175',display_name='tempest-VolumesGetTest-Volume-354525887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514de91d-dbe7-4b96-8656-024b63881110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:51Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Creating volume 514de91d-dbe7-4b96-8656-024b63881110 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:46:51 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62dd9e8-179b-4c99-a44a-7de9446515d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45249ace-58bd-47ed-b971-f3bde152aeaf', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:51 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110 1073741824 Apr 29 16:46:51 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8143f621-e4c4-40fa-8e0a-fd602ef9404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:52 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Volume volume-45249ace-58bd-47ed-b971-f3bde152aeaf (45249ace-58bd-47ed-b971-f3bde152aeaf): created successfully Apr 29 16:46:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8143f621-e4c4-40fa-8e0a-fd602ef9404b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Flow 'volume_create_manager' (e1edd891-6fc7-4043-8e97-7e2bc7defd58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e7ed848e-5f0e-42ec-b6d8-b80fd5f98c0b tempest-GroupSnapshotsV319Test-1012620345 None] Created volume successfully. Apr 29 16:46:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] GroupSnapshot 07156f44-a02f-45d7-80a2-1968803650ee: creating. Apr 29 16:46:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Group snapshot 07156f44-a02f-45d7-80a2-1968803650ee: creating. {{(pid=84201) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 16:46:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:52 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110 1073741824" returned: 0 in 0.984s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:52 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110 Apr 29 16:46:53 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:53 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110" returned: 0 in 0.621s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.860s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Creating offline snapshot 20100e7f-0094-4432-ba42-6a310addebb9 of volume 45249ace-58bd-47ed-b971-f3bde152aeaf {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e2dc93-5ef3-4319-ad24-f0d636020419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514de91d-dbe7-4b96-8656-024b63881110', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d6d0cb-e61b-47c1-aa9c-ee6a053a7c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4087bc61-f59a-4310-b3d5-d9e5fce4f457]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:53 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Volume volume-514de91d-dbe7-4b96-8656-024b63881110 (514de91d-dbe7-4b96-8656-024b63881110): created successfully Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d6d0cb-e61b-47c1-aa9c-ee6a053a7c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (4ffd23af-f809-402c-ba95-0b0398d00441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:53 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ce14f704-4342-4abe-bb07-9e863716568b tempest-VolumesGetTest-562840024 None] Created volume successfully. Apr 29 16:46:53 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf Apr 29 16:46:53 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:54 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf" returned: 0 in 0.828s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:54 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 1G Apr 29 16:46:54 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-514de91d-dbe7-4b96-8656-024b63881110-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Lock "cinder-514de91d-dbe7-4b96-8656-024b63881110-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-quobyte-514de91d-dbe7-4b96-8656-024b63881110" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-514de91d-dbe7-4b96-8656-024b63881110" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:54 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fc327b-92ca-4560-99ca-a8689c956b2b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:55 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110 Apr 29 16:46:55 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:55 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 1G" returned: 0 in 1.008s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45249ace-58bd-47ed-b971-f3bde152aeaf -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:55 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45249ace-58bd-47ed-b971-f3bde152aeaf -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 Apr 29 16:46:55 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:56 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110" returned: 0 in 1.158s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:56 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110 Apr 29 16:46:56 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Flow 'volume_create_manager' (dd596f71-7a6a-4fa0-8503-fdff2611e34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73653515-b73d-4a91-9e34-1750ac87d88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73653515-b73d-4a91-9e34-1750ac87d88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1257696383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08647362-a280-498e-9dff-0d7a1145648e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e185ab8c9094d6198c3416418286978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:56Z,use_quota=True,user_id='1e01df4a766b4a02810b92a2427da75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4a81ce-dde9-40f7-9577-2003ca21eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4a81ce-dde9-40f7-9577-2003ca21eed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f803d07-fea0-4da9-994a-2b27ec1906fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f803d07-fea0-4da9-994a-2b27ec1906fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08647362-a280-498e-9dff-0d7a1145648e', 'volume_name': 'volume-08647362-a280-498e-9dff-0d7a1145648e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eaac112-ec72-4dc0-b270-cb5ea26b1dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eaac112-ec72-4dc0-b270-cb5ea26b1dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69edbbff-db1b-405e-bf51-25ba3dc7a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:46:56 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Volume 08647362-a280-498e-9dff-0d7a1145648e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08647362-a280-498e-9dff-0d7a1145648e', 'volume_size': 1} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:56 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45249ace-58bd-47ed-b971-f3bde152aeaf -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9" returned: 0 in 0.931s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:56 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:56 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 Apr 29 16:46:56 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:56 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-514de91d-dbe7-4b96-8656-024b63881110" returned: 0 in 0.716s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-514de91d-dbe7-4b96-8656-024b63881110" released by "delete_volume" :: held 1.940s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Created reservations ['74855246-3bf4-48bb-9c4f-6af748eaefd7', 'ff1485a7-ab68-4703-a068-b3de21c8b2fe', '25608289-69ed-4598-8e53-45029254549c', 'a7a6f09e-3ab3-4bea-9522-7ccc4608c324'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:56 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:46:56 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:57 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9" returned: 0 in 0.686s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:57 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.info Apr 29 16:46:57 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-4d16ad07-6966-47aa-af95-a57988cdc760-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Lock "cinder-4d16ad07-6966-47aa-af95-a57988cdc760-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-quobyte-4d16ad07-6966-47aa-af95-a57988cdc760" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-4d16ad07-6966-47aa-af95-a57988cdc760" acquired by "delete_volume" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[661867b7-b909-4d46-8e47-569218bbed59]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:57 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760 Apr 29 16:46:57 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:57 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.791s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:46:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Deleted volume successfully. Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f1c2899d-34ca-40b6-857e-8361be176df5 tempest-VolumesGetTest-562840024 None] Lock "cinder-514de91d-dbe7-4b96-8656-024b63881110-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:57 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.info" returned: 0 in 0.726s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:57 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:46:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:57 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.info Apr 29 16:46:57 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:58 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760" returned: 0 in 0.820s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:58 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760 Apr 29 16:46:58 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:58 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.info" returned: 0 in 0.706s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.023s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.319s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1257696383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08647362-a280-498e-9dff-0d7a1145648e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e185ab8c9094d6198c3416418286978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:46:56Z,use_quota=True,user_id='1e01df4a766b4a02810b92a2427da75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Creating volume 08647362-a280-498e-9dff-0d7a1145648e {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:46:58 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:58 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e 1073741824 Apr 29 16:46:58 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:58 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-81365193-54c0-4eba-9d46-35fe8bb5fb68 tempest-GroupSnapshotsV319Test-1012620345 None] group_snapshot 07156f44-a02f-45d7-80a2-1968803650ee: created successfully Apr 29 16:46:58 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4d16ad07-6966-47aa-af95-a57988cdc760" returned: 0 in 0.643s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-4d16ad07-6966-47aa-af95-a57988cdc760" released by "delete_volume" :: held 1.522s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:46:58 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Created reservations ['5818a988-139c-4bd2-8108-d8b08c842474', 'b2dfdbfa-4667-4f2b-98ff-8217d80a0584', 'e7815118-9c55-4601-a121-c6756791f085', '61446a5d-2e0b-40be-979e-c13bce314ed1'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:59 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:46:59 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:59 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e 1073741824" returned: 0 in 0.975s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] group_snapshot 07156f44-a02f-45d7-80a2-1968803650ee: deleting Apr 29 16:46:59 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e Apr 29 16:46:59 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] group_snapshot 07156f44-a02f-45d7-80a2-1968803650ee: deleting {{(pid=84201) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Acquiring lock "cinder-quobyte-45249ace-58bd-47ed-b971-f3bde152aeaf" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Lock "cinder-quobyte-45249ace-58bd-47ed-b971-f3bde152aeaf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Acquiring lock "cinder-quobyte-20100e7f-0094-4432-ba42-6a310addebb9" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Lock "cinder-quobyte-20100e7f-0094-4432-ba42-6a310addebb9" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Deleting offline snapshot 20100e7f-0094-4432-ba42-6a310addebb9 of volume 45249ace-58bd-47ed-b971-f3bde152aeaf {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:46:59 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] snapshot_file for this snap is: volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.821s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:46:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Deleted volume successfully. Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6ed423-20f4-4077-9a26-79d37fa4786f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:46:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-339509b5-b69e-4056-8a3c-ad35e7f2a328 tempest-VolumesGetTest-562840024 None] Lock "cinder-4d16ad07-6966-47aa-af95-a57988cdc760-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:00 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 Apr 29 16:47:00 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:00 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e" returned: 0 in 0.802s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69edbbff-db1b-405e-bf51-25ba3dc7a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08647362-a280-498e-9dff-0d7a1145648e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bec93c-e493-4a32-a401-e097985b7784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:00 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Volume volume-08647362-a280-498e-9dff-0d7a1145648e (08647362-a280-498e-9dff-0d7a1145648e): created successfully Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bec93c-e493-4a32-a401-e097985b7784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Flow 'volume_create_manager' (dd596f71-7a6a-4fa0-8503-fdff2611e34f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:00 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-fb8a96ce-d7ab-4718-a37b-e5a589afc384 req-84e05781-b5c8-412d-91f4-c99f00b89a4f tempest-VolumesSnapshotsTestJSON-1354350061 None] Created volume successfully. Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (78a5dc3d-0589-4b2e-8e8f-524c873ad570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f87b8b-c109-4846-9148-aaf435e31c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f87b8b-c109-4846-9148-aaf435e31c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-699546866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:01Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217f9d0c-257e-4bde-b3ce-86b3bb7ddfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217f9d0c-257e-4bde-b3ce-86b3bb7ddfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2031d4-6b2a-4d7d-b653-b95a1fc2a205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2031d4-6b2a-4d7d-b653-b95a1fc2a205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3', 'volume_name': 'volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87544019-c204-4a8f-9921-49cbbae77a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87544019-c204-4a8f-9921-49cbbae77a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7ce125-af54-40fb-a8f3-068bde92e966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:00 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Volume b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3', 'volume_size': 1} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-699546866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:01Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Creating volume b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:47:00 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:47:00 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 1073741824 Apr 29 16:47:00 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Flow 'volume_create_manager' (3c4a3a42-b36c-4059-b2d8-d1c67b604d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc929ea-48a8-458d-a556-72d1cb712533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc929ea-48a8-458d-a556-72d1cb712533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1492754047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0733b722-502e-40da-9ab1-363efc0ea78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4312e46508c441c1aecf5eb795b7c34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:01Z,use_quota=True,user_id='8e0d39977b594f8d99f513cc318d51b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bec53e-0b96-455b-9b0e-0f22adc58dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bec53e-0b96-455b-9b0e-0f22adc58dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:01 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf31b81-4246-4c3f-bf55-b05decacbe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.image.glance [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Creating Keystone auth plugin from conf {{(pid=84201) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9" returned: 0 in 1.134s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45249ace-58bd-47ed-b971-f3bde152aeaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65b0260-9c87-46a8-8662-a51466aade10]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:01 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf Apr 29 16:47:01 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf31b81-4246-4c3f-bf55-b05decacbe99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0733b722-502e-40da-9ab1-363efc0ea78e', 'volume_name': 'volume-0733b722-502e-40da-9ab1-363efc0ea78e', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49264cd-5c7a-4177-9e10-880f86e1944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49264cd-5c7a-4177-9e10-880f86e1944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b2a00b-19cb-478c-829f-233f8ed632f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:01 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Volume 0733b722-502e-40da-9ab1-363efc0ea78e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0733b722-502e-40da-9ab1-363efc0ea78e', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Trying to clone 0733b722-502e-40da-9ab1-363efc0ea78e from image 41e2d651-26b7-481d-97f0-de8b038b5cd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]). {{(pid=84201) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 16:47:01 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Image download 20.69 MB at 20.69 MB/s Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e202550-3c79-4d1e-a2b7-da1c889561a8]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:01 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf" returned: 0 in 0.889s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:01 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD Apr 29 16:47:01 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:01 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 Apr 29 16:47:02 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:02 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 1073741824" returned: 0 in 1.161s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:02 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 Apr 29 16:47:02 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:02 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD" returned: 0 in 0.838s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Temporary image 41e2d651-26b7-481d-97f0-de8b038b5cd4 is fetched for user 8e0d39977b594f8d99f513cc318d51b2. {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 16:47:02 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9" returned: 0 in 0.795s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:02 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" returned: 0 in 0.739s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:02 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9 Apr 29 16:47:02 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.704s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7ce125-af54-40fb-a8f3-068bde92e966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32d6fd1-0a00-47db-bf65-909affb8c7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Creating offline snapshot cbfab012-0fb7-42f9-8443-fb08c58bad3a of volume 08647362-a280-498e-9dff-0d7a1145648e {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2561b988-f01f-4e21-855f-be5f138dc266]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aebd4c-ce30-438f-8b6a-7bf72a2a55b5]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:02 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Volume volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 (b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3): created successfully Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32d6fd1-0a00-47db-bf65-909affb8c7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (78a5dc3d-0589-4b2e-8e8f-524c873ad570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:02 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-beeda639-b03e-4176-9d65-a0c9cfc0d325 tempest-VolumesGetTest-562840024 None] Created volume successfully. Apr 29 16:47:02 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD Apr 29 16:47:02 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:03 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e Apr 29 16:47:03 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:03 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf.20100e7f-0094-4432-ba42-6a310addebb9" returned: 0 in 0.694s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Lock "cinder-quobyte-20100e7f-0094-4432-ba42-6a310addebb9" released by "_delete_snapshot" :: held 3.657s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Lock "cinder-quobyte-45249ace-58bd-47ed-b971-f3bde152aeaf" released by "delete_snapshot" :: held 3.707s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:03 devstack cinder-volume[84201]: WARNING cinder.quota [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-933549038 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-933549038, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:47:03 devstack cinder-volume[84201]: WARNING cinder.quota [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-933549038 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-933549038, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:47:03 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] Created reservations ['38ba1d21-be02-44bc-8797-257412ba43c4', '56b2e518-571c-49ae-9cca-da20997b7fb4', 'df72c9bb-c9e8-42d6-b3ca-172700eb724d', 'bc472e5f-a092-4555-ae5b-4b3cfa64d610'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:03 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD" returned: 0 in 0.768s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c2d105a4-4a54-49f8-a459-8523e474a371 tempest-GroupSnapshotsV319Test-1012620345 None] group_snapshot 07156f44-a02f-45d7-80a2-1968803650ee: deleted successfully Apr 29 16:47:03 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e" returned: 0 in 0.820s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:03 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a 1G Apr 29 16:47:03 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Acquiring lock "cinder-quobyte-45249ace-58bd-47ed-b971-f3bde152aeaf" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Lock "cinder-quobyte-45249ace-58bd-47ed-b971-f3bde152aeaf" acquired by "delete_volume" :: waited 0.032s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d23dd-cb94-4bbb-8c67-1518623ff40f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:04 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf Apr 29 16:47:04 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (b4af258e-22e9-4970-9fd0-384a2e03c5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6d7992-f158-4e0d-b3cf-638db4658253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6d7992-f158-4e0d-b3cf-638db4658253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-749903960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:04Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61cc13b-6c0c-4154-99eb-d02f0b5e656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61cc13b-6c0c-4154-99eb-d02f0b5e656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a4b311-d254-446a-b0ec-0d3e5393d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a4b311-d254-446a-b0ec-0d3e5393d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3', 'volume_name': 'volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3', 'volume_size': 1, 'source_volid': 'b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3', 'source_volstatus': 'available'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e30417-0104-4a97-b04a-6eff0efd9ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e30417-0104-4a97-b04a-6eff0efd9ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532f910d-243d-4092-ab64-4e0e5d92a130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:04 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Volume ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3', 'volume_size': 1, 'source_volid': 'b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3', 'source_volstatus': 'available'} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:04 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a 1G" returned: 0 in 0.929s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08647362-a280-498e-9dff-0d7a1145648e -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:04 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08647362-a280-498e-9dff-0d7a1145648e -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a Apr 29 16:47:04 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:04 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:47:04 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:05 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf" returned: 0 in 0.789s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:05 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf Apr 29 16:47:05 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:05 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08647362-a280-498e-9dff-0d7a1145648e -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a" returned: 0 in 0.709s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:05 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a is being set with open permissions: ugo+rw Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:05 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a Apr 29 16:47:05 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:05 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.703s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:47:05 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-45249ace-58bd-47ed-b971-f3bde152aeaf" returned: 0 in 0.652s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Lock "cinder-quobyte-45249ace-58bd-47ed-b971-f3bde152aeaf" released by "delete_volume" :: held 1.526s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Created reservations ['3bd1d724-ba38-46cf-93e1-0b3c07bc5a86'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:05 devstack cinder-volume[84201]: WARNING cinder.quota [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-933549038 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-933549038, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Created reservations ['99414305-fe3a-4b70-a7f7-8b3388690fdf', '0aaf5781-f9e6-403e-af8c-574078ea0460', '74256eaf-843f-4d84-b224-d49538e259c7', '67ef8609-8799-4361-a9ae-a59377f7441c'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:05 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a" returned: 0 in 0.665s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:06 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:47:06 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:06 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.info Apr 29 16:47:06 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:06 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.643s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:06 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:47:06 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-af28b525-3f19-43c6-ad53-1bcba559603e tempest-GroupSnapshotsV319Test-1012620345 None] Delete group completed successfully. Apr 29 16:47:06 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.info" returned: 0 in 0.656s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:06 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.info is being set with open permissions: ugo+rw Apr 29 16:47:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:06 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.info Apr 29 16:47:06 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:07 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.info" returned: 0 in 0.641s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.569s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.758s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1492754047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0733b722-502e-40da-9ab1-363efc0ea78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4312e46508c441c1aecf5eb795b7c34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:01Z,use_quota=True,user_id='8e0d39977b594f8d99f513cc318d51b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Creating volume 0733b722-502e-40da-9ab1-363efc0ea78e {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:47:07 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:07 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e 1073741824 Apr 29 16:47:07 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-677d048b-02d8-4328-af94-d8e01139825e req-27adc0df-70d3-4775-ae16-56ecbaf8b513 tempest-VolumesSnapshotsTestJSON-1354350061 None] Create snapshot completed successfully Apr 29 16:47:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Acquiring lock "cinder-cbfab012-0fb7-42f9-8443-fb08c58bad3a-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-cbfab012-0fb7-42f9-8443-fb08c58bad3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Acquiring lock "cinder-quobyte-08647362-a280-498e-9dff-0d7a1145648e" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-quobyte-08647362-a280-498e-9dff-0d7a1145648e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Acquiring lock "cinder-quobyte-cbfab012-0fb7-42f9-8443-fb08c58bad3a" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-quobyte-cbfab012-0fb7-42f9-8443-fb08c58bad3a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Deleting offline snapshot cbfab012-0fb7-42f9-8443-fb08c58bad3a of volume 08647362-a280-498e-9dff-0d7a1145648e {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] snapshot_file for this snap is: volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf32cf8-b1ab-4c19-b093-5b9e9ed5be98]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:08 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a Apr 29 16:47:08 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:08 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e 1073741824" returned: 0 in 0.908s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:08 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e Apr 29 16:47:08 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:08 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a" returned: 0 in 0.795s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08647362-a280-498e-9dff-0d7a1145648e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4c1ac1-9f39-489d-9b3b-0fe4db5908a9]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:09 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e Apr 29 16:47:09 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:09 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e" returned: 0 in 0.736s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.479s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:09 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Cloning volume b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 to volume ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Attempting download of 41e2d651-26b7-481d-97f0-de8b038b5cd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}])) to volume 0733b722-502e-40da-9ab1-363efc0ea78e. {{(pid=84201) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Creating offline snapshot 27ca0471-e333-4dba-91ba-eac314a921bd of volume b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c67f8c-bbd6-421b-a8f9-b8068b2a30f5]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a67e7d5-ca83-4f24-b3d6-c82376d99139]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_6rmrvzjw {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:09 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 Apr 29 16:47:09 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:09 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_6rmrvzjw Apr 29 16:47:09 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:09 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e" returned: 0 in 0.931s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:09 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a Apr 29 16:47:09 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:10 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" returned: 0 in 0.871s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:10 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_6rmrvzjw" returned: 0 in 0.856s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_6rmrvzjw {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:10 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd 1G Apr 29 16:47:10 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:10 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_6rmrvzjw Apr 29 16:47:10 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:10 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a" returned: 0 in 0.739s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:10 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a Apr 29 16:47:10 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:10 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_6rmrvzjw" returned: 1 in 0.823s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_6rmrvzjw' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c29072-a24d-42c6-ab16-7ac2a7d8a78e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:11 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd 1G" returned: 0 in 0.941s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:11 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd Apr 29 16:47:11 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:11 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD Apr 29 16:47:11 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:11 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e.cbfab012-0fb7-42f9-8443-fb08c58bad3a" returned: 0 in 0.778s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-quobyte-cbfab012-0fb7-42f9-8443-fb08c58bad3a" released by "_delete_snapshot" :: held 3.408s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-quobyte-08647362-a280-498e-9dff-0d7a1145648e" released by "delete_snapshot" :: held 3.436s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:11 devstack cinder-volume[84201]: WARNING cinder.quota [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG cinder.quota [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Created reservations ['611c4561-c0a0-44ff-b28e-32d28f82cf45', '4b1d9a6f-9eb9-4ee5-b6aa-ecda1d7bb03b', '540989ae-361b-4b0f-9b9c-e5c4762e8dda', '8433a4e1-2aff-4641-aace-37edd84a331c'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Delete snapshot completed successfully. Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-7e75cf76-9c2f-4af9-9efe-fc8a42af86d8 req-63293a55-1783-4b34-b9b3-2f726bc9da5d tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-cbfab012-0fb7-42f9-8443-fb08c58bad3a-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:11 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD" returned: 0 in 0.943s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] 41e2d651-26b7-481d-97f0-de8b038b5cd4 was qcow2, converting to raw {{(pid=84201) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:11 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e Apr 29 16:47:11 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:11 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd" returned: 0 in 0.942s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:11 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd is being set with open permissions: ugo+rw Apr 29 16:47:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:11 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd Apr 29 16:47:11 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Flow 'volume_create_manager' (33f032f5-1878-4619-8799-fc5811050206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c353cf-b3a1-4237-a412-859e066c346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c353cf-b3a1-4237-a412-859e066c346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1631907254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02550cb-432d-4883-ad87-6a51e54d15a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dfed73f4154da69d7a2d355771b422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:12Z,use_quota=True,user_id='38a169aa28614c418aa3687caec7cbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622a0249-746c-4d72-a072-3b12ab954b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622a0249-746c-4d72-a072-3b12ab954b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20e81e9-d4c1-4fa5-9dab-d7a9df6fe64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20e81e9-d4c1-4fa5-9dab-d7a9df6fe64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02550cb-432d-4883-ad87-6a51e54d15a5', 'volume_name': 'volume-f02550cb-432d-4883-ad87-6a51e54d15a5', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f297a6d-a85e-40ff-972d-4386042bd772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f297a6d-a85e-40ff-972d-4386042bd772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04330531-36bc-4ac0-ad39-bb76c02233db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:12 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Volume f02550cb-432d-4883-ad87-6a51e54d15a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02550cb-432d-4883-ad87-6a51e54d15a5', 'volume_size': 1} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Acquiring lock "cinder-08647362-a280-498e-9dff-0d7a1145648e-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-08647362-a280-498e-9dff-0d7a1145648e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Acquiring lock "cinder-quobyte-08647362-a280-498e-9dff-0d7a1145648e" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-quobyte-08647362-a280-498e-9dff-0d7a1145648e" acquired by "delete_volume" :: waited 0.028s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:12 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd" returned: 0 in 0.707s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093c5ca-a161-4c12-a84b-84fbd0e9c5bc]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:12 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.info Apr 29 16:47:12 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:12 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e Apr 29 16:47:12 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:13 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.info" returned: 0 in 0.614s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:13 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.info is being set with open permissions: ugo+rw Apr 29 16:47:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:13 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.info Apr 29 16:47:13 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:13 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e" returned: 0 in 0.862s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:13 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e Apr 29 16:47:13 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:13 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e" returned: 0 in 2.088s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:13 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_0bmhvhs2devstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:47:13 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Converted 112.00 MB image at 53.61 MB/s Apr 29 16:47:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:13 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e 1G Apr 29 16:47:13 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:14 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.info" returned: 0 in 0.721s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-quobyte-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] snapshot: 27ca0471-e333-4dba-91ba-eac314a921bd, volume: ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a94133b-f56a-4e49-a3e1-82aa020a989f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:14 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd Apr 29 16:47:14 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:14 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-08647362-a280-498e-9dff-0d7a1145648e" returned: 0 in 0.768s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-quobyte-08647362-a280-498e-9dff-0d7a1145648e" released by "delete_volume" :: held 1.701s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.quota [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Created reservations ['a5390d60-3186-415f-a1f6-ae2ab70442ab', 'e8c5fdaa-7419-4c11-830d-a19b0c9b7b6d', 'fa90f081-8ff1-495d-9cb9-258c992deec3', '13e68f02-a502-409e-9ec3-7702b7afe03b'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:14 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:47:14 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:14 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e 1G" returned: 0 in 0.656s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2928706c-e4d8-448e-b352-5c6bdd29524f]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:14 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e Apr 29 16:47:14 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:14 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd" returned: 0 in 0.834s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9773b55f-3293-486a-9036-bf032eaab4f4]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:15 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.629s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:15 devstack cinder-volume[84201]: DEBUG cinder.manager [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:47:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Deleted volume successfully. Apr 29 16:47:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [req-a9c46db7-32bb-489d-a6d6-374a21c82b36 req-57861c82-590d-47e6-a868-8ab03ec715ab tempest-VolumesSnapshotsTestJSON-1354350061 None] Lock "cinder-08647362-a280-498e-9dff-0d7a1145648e-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:15 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 Apr 29 16:47:15 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:15 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e" returned: 0 in 0.868s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:15 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e Apr 29 16:47:15 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:15 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" returned: 0 in 0.829s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:15 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:47:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:15 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 Apr 29 16:47:15 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:16 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e" returned: 1 in 0.787s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Downloaded image 41e2d651-26b7-481d-97f0-de8b038b5cd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}])) to volume 0733b722-502e-40da-9ab1-363efc0ea78e successfully. {{(pid=84201) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Temporary image 41e2d651-26b7-481d-97f0-de8b038b5cd4 for user 8e0d39977b594f8d99f513cc318d51b2 is deleted. {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Marking volume 0733b722-502e-40da-9ab1-363efc0ea78e as bootable. {{(pid=84201) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Copying metadata from image 41e2d651-26b7-481d-97f0-de8b038b5cd4 to 0733b722-502e-40da-9ab1-363efc0ea78e. {{(pid=84201) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Creating volume glance metadata for volume 0733b722-502e-40da-9ab1-363efc0ea78e backed by image 41e2d651-26b7-481d-97f0-de8b038b5cd4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84201) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b2a00b-19cb-478c-829f-233f8ed632f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0733b722-502e-40da-9ab1-363efc0ea78e', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dc0660-4533-4570-9c5c-e6920c6999ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:16 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Volume volume-0733b722-502e-40da-9ab1-363efc0ea78e (0733b722-502e-40da-9ab1-363efc0ea78e): created successfully Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dc0660-4533-4570-9c5c-e6920c6999ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Flow 'volume_create_manager' (3c4a3a42-b36c-4059-b2d8-d1c67b604d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:16 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-70ea447b-7a89-43cd-8655-48033483e0d7 tempest-VolumesImageMetadata-772435941 None] Created volume successfully. Apr 29 16:47:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Acquiring lock "cinder-0733b722-502e-40da-9ab1-363efc0ea78e-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Lock "cinder-0733b722-502e-40da-9ab1-363efc0ea78e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Acquiring lock "cinder-quobyte-0733b722-502e-40da-9ab1-363efc0ea78e" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Lock "cinder-quobyte-0733b722-502e-40da-9ab1-363efc0ea78e" acquired by "delete_volume" :: waited 0.034s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:18 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b22b39-e3d7-4631-9838-1e07cf2b0373]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:18 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e Apr 29 16:47:18 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:20 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e" returned: 0 in 1.937s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:20 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e Apr 29 16:47:20 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:21 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" returned: 0 in 5.622s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:21 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e0ef6c-deb0-4a65-b8b3-37a6574dce23]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:21 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 Apr 29 16:47:21 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:21 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e" returned: 1 in 1.366s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:47:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:21 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e Apr 29 16:47:21 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:22 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0733b722-502e-40da-9ab1-363efc0ea78e" returned: 0 in 0.657s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Lock "cinder-quobyte-0733b722-502e-40da-9ab1-363efc0ea78e" released by "delete_volume" :: held 4.085s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:22 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" returned: 0 in 0.928s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:47:22 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Converted 1024.00 MB image at 182.09 MB/s Apr 29 16:47:22 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 is being set with open permissions: ugo+rw Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:22 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 Apr 29 16:47:22 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Created reservations ['7031fd10-1118-4108-a5df-52e0542ea93a', 'b708378d-f618-4ab8-ad0c-b67a910bb465', '62b56481-432c-4eb7-ace7-92728aa2d19d', 'ebd86d6a-7646-4ba0-a485-2acc761314ec'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:22 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:47:22 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:23 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" returned: 0 in 0.811s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" released by "_copy_volume_from_snapshot" :: held 9.140s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-quobyte-27ca0471-e333-4dba-91ba-eac314a921bd" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-27ca0471-e333-4dba-91ba-eac314a921bd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Deleting offline snapshot 27ca0471-e333-4dba-91ba-eac314a921bd of volume b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:47:23 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] snapshot_file for this snap is: volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.747s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cce100-11a3-42d6-b4a6-3bde53ec75d1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:23 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Deleted volume successfully. Apr 29 16:47:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7e39a5a1-4582-4997-9ff0-8bf29d967cb6 tempest-VolumesImageMetadata-772435941 None] Lock "cinder-0733b722-502e-40da-9ab1-363efc0ea78e-delete_volume" released by "delete_volume" :: held 5.197s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:23 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd Apr 29 16:47:23 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:24 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd" returned: 0 in 0.779s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:47:24 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[34faa71b-5158-4310-a215-924062afca09]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:24 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 Apr 29 16:47:24 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:24 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" returned: 0 in 0.756s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:24 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd Apr 29 16:47:24 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:25 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd" returned: 0 in 0.754s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:25 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd Apr 29 16:47:25 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:25 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=102,cinder:UPDATE=131,cinder:INSERT=35,cinder:DELETE=8 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:47:25 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-050c4a98-348f-4c6a-a230-b314f0d2d0c4 tempest-GroupSnapshotsTest-830361566 None] Group tempest-GroupSnapshotsTest-Group-1048724702: creating Apr 29 16:47:25 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=112,cinder:INSERT=39,cinder:UPDATE=123,cinder:DELETE=10 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:47:25 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-050c4a98-348f-4c6a-a230-b314f0d2d0c4 tempest-GroupSnapshotsTest-830361566 None] Group tempest-GroupSnapshotsTest-Group-1048724702: created successfully Apr 29 16:47:25 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-050c4a98-348f-4c6a-a230-b314f0d2d0c4 tempest-GroupSnapshotsTest-830361566 None] Create group completed successfully. Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Flow 'volume_create_manager' (c632d764-c8fd-4a6e-a5cc-fab55909aa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c171119e-b0aa-4fa8-8ea3-cc714af2023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c171119e-b0aa-4fa8-8ea3-cc714af2023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-442791763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7461c588-6ee9-440a-8799-70b092b8681a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6203baed434d20b426670f6af9e245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:26Z,use_quota=True,user_id='9121f7f93080417c83955cfeefaf8658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a271305f-9699-4345-ad8a-a15058a51d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a271305f-9699-4345-ad8a-a15058a51d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf02045-4568-4c3c-b5e0-ed6380baad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf02045-4568-4c3c-b5e0-ed6380baad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7461c588-6ee9-440a-8799-70b092b8681a', 'volume_name': 'volume-7461c588-6ee9-440a-8799-70b092b8681a', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2601e4-60a3-49c6-ad6f-a5768c09b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2601e4-60a3-49c6-ad6f-a5768c09b24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ae3243-ed85-4cb1-83b4-034b9a24e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:26 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Volume 7461c588-6ee9-440a-8799-70b092b8681a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7461c588-6ee9-440a-8799-70b092b8681a', 'volume_size': 1} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:26 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3.27ca0471-e333-4dba-91ba-eac314a921bd" returned: 0 in 0.601s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-27ca0471-e333-4dba-91ba-eac314a921bd" released by "_delete_snapshot" :: held 2.990s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.183s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.978s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1631907254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02550cb-432d-4883-ad87-6a51e54d15a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dfed73f4154da69d7a2d355771b422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:12Z,use_quota=True,user_id='38a169aa28614c418aa3687caec7cbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Creating volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:47:26 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532f910d-243d-4092-ab64-4e0e5d92a130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3', 'volume_size': 1, 'source_volid': 'b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3', 'source_volstatus': 'available'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:26 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 1073741824 Apr 29 16:47:26 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f37345-5cef-4497-912c-9ee0cda23335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:26 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Volume volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 (ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3): created successfully Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f37345-5cef-4497-912c-9ee0cda23335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (b4af258e-22e9-4970-9fd0-384a2e03c5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:26 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-afc58c4a-4bfa-4e76-81a4-53a01b9904ce tempest-VolumesGetTest-562840024 None] Created volume successfully. Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (ddbd5ffb-90ee-4a22-9df5-af71a870014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9975968a-7576-4b21-a6bf-04d2b014d86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 1073741824" returned: 0 in 0.868s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9975968a-7576-4b21-a6bf-04d2b014d86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-824924050',display_name='tempest-VolumesGetTest-Volume-1673534718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22565399-fa7d-4795-95d6-f4d140a90e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:27Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d84303b-ff97-4712-9946-2c62191331f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d84303b-ff97-4712-9946-2c62191331f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98f4428-18bd-4862-a318-720accaf22a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98f4428-18bd-4862-a318-720accaf22a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22565399-fa7d-4795-95d6-f4d140a90e48', 'volume_name': 'volume-22565399-fa7d-4795-95d6-f4d140a90e48', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a739fb-4038-45ff-a560-9ee5240c0a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a739fb-4038-45ff-a560-9ee5240c0a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5383d468-36a3-4728-9c70-77ef5fa1f342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Volume 22565399-fa7d-4795-95d6-f4d140a90e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22565399-fa7d-4795-95d6-f4d140a90e48', 'volume_size': 1} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:27 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 Apr 29 16:47:27 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Flow 'volume_create_manager' (78972bc7-4294-449a-b724-7dcda4e284e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e095ff7-35f6-46b8-9fb1-0d47866a820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e095ff7-35f6-46b8-9fb1-0d47866a820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508137096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d84e61e-90e8-4eb6-8097-79ddc7cfcbdc,host='devstack@QuobyteHD#QuobyteHD',id=42ef85d6-98e9-4a50-a446-74831bc908b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f907c13f34a4ec087249e7d46bac41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:27Z,use_quota=True,user_id='e661db529ff441c2b44a45eac3735721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c646b17-bd03-4662-a943-5c024a4c491b),volume_type_id=4c646b17-bd03-4662-a943-5c024a4c491b)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f78ac1-1c78-4a40-b023-6b48d185e8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f78ac1-1c78-4a40-b023-6b48d185e8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c68c05-afb7-489f-96fe-89c46b71f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c68c05-afb7-489f-96fe-89c46b71f333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ef85d6-98e9-4a50-a446-74831bc908b1', 'volume_name': 'volume-42ef85d6-98e9-4a50-a446-74831bc908b1', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf76b02-9b7a-4049-bf48-920366fc7ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf76b02-9b7a-4049-bf48-920366fc7ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e41dca-b5b2-4072-8997-1781c469d606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Volume 42ef85d6-98e9-4a50-a446-74831bc908b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ef85d6-98e9-4a50-a446-74831bc908b1', 'volume_size': 1} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:27 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5" returned: 0 in 0.647s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.675s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-442791763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7461c588-6ee9-440a-8799-70b092b8681a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6203baed434d20b426670f6af9e245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:26Z,use_quota=True,user_id='9121f7f93080417c83955cfeefaf8658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Creating volume 7461c588-6ee9-440a-8799-70b092b8681a {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:47:27 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:27 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a 1073741824 Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04330531-36bc-4ac0-ad39-bb76c02233db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02550cb-432d-4883-ad87-6a51e54d15a5', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e49c2e-a154-4821-9006-2a1e86f266cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:27 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Volume volume-f02550cb-432d-4883-ad87-6a51e54d15a5 (f02550cb-432d-4883-ad87-6a51e54d15a5): created successfully Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e49c2e-a154-4821-9006-2a1e86f266cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:27 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Flow 'volume_create_manager' (33f032f5-1878-4619-8799-fc5811050206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:27 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f3f16c07-bad9-421e-b700-e5c431d82183 tempest-SnapshotsActionsTest-852101935 None] Created volume successfully. Apr 29 16:47:28 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a 1073741824" returned: 0 in 0.748s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:28 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a Apr 29 16:47:28 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:29 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a" returned: 0 in 0.609s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-824924050',display_name='tempest-VolumesGetTest-Volume-1673534718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22565399-fa7d-4795-95d6-f4d140a90e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:27Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Creating volume 22565399-fa7d-4795-95d6-f4d140a90e48 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:47:29 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ae3243-ed85-4cb1-83b4-034b9a24e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7461c588-6ee9-440a-8799-70b092b8681a', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c6ec63-5fee-4b52-a6c8-6226aef3b16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:29 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48 1073741824 Apr 29 16:47:29 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:29 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Volume volume-7461c588-6ee9-440a-8799-70b092b8681a (7461c588-6ee9-440a-8799-70b092b8681a): created successfully Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c6ec63-5fee-4b52-a6c8-6226aef3b16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Flow 'volume_create_manager' (c632d764-c8fd-4a6e-a5cc-fab55909aa69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:29 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-cca24235-da2e-4481-be2e-c56458643e54 tempest-SnapshotMetadataTestJSON-1663556856 None] Created volume successfully. Apr 29 16:47:30 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48 1073741824" returned: 0 in 0.759s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:30 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48 Apr 29 16:47:30 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:30 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48" returned: 0 in 0.599s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.166s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d84e61e-90e8-4eb6-8097-79ddc7cfcbdc,created_at=2026-04-29T14:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508137096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d84e61e-90e8-4eb6-8097-79ddc7cfcbdc,host='devstack@QuobyteHD#QuobyteHD',id=42ef85d6-98e9-4a50-a446-74831bc908b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f907c13f34a4ec087249e7d46bac41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:27Z,use_quota=True,user_id='e661db529ff441c2b44a45eac3735721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c646b17-bd03-4662-a943-5c024a4c491b),volume_type_id=4c646b17-bd03-4662-a943-5c024a4c491b)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Creating volume 42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:47:30 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5383d468-36a3-4728-9c70-77ef5fa1f342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22565399-fa7d-4795-95d6-f4d140a90e48', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:30 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 1073741824 Apr 29 16:47:30 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4578b3-e3df-42ed-9d0d-836ab4f30148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:30 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Volume volume-22565399-fa7d-4795-95d6-f4d140a90e48 (22565399-fa7d-4795-95d6-f4d140a90e48): created successfully Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4578b3-e3df-42ed-9d0d-836ab4f30148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (ddbd5ffb-90ee-4a22-9df5-af71a870014f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-19c30fc9-945b-41c6-a49f-1507923f7607 tempest-VolumesGetTest-562840024 None] Created volume successfully. Apr 29 16:47:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-22565399-fa7d-4795-95d6-f4d140a90e48-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:31 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Lock "cinder-22565399-fa7d-4795-95d6-f4d140a90e48-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 1073741824" returned: 0 in 0.845s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-quobyte-22565399-fa7d-4795-95d6-f4d140a90e48" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:31 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 Apr 29 16:47:31 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-22565399-fa7d-4795-95d6-f4d140a90e48" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:31 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f3264-1ec7-497a-87f9-372e3e36c21e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:31 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48 Apr 29 16:47:31 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:32 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1" returned: 0 in 0.594s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.216s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e41dca-b5b2-4072-8997-1781c469d606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ef85d6-98e9-4a50-a446-74831bc908b1', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba471fd-b339-476f-89e9-d0fae258f8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Creating offline snapshot f03b724c-cb2b-4906-8613-7ae8f7af71f2 of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:47:32 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Volume volume-42ef85d6-98e9-4a50-a446-74831bc908b1 (42ef85d6-98e9-4a50-a446-74831bc908b1): created successfully Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba471fd-b339-476f-89e9-d0fae258f8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Flow 'volume_create_manager' (78972bc7-4294-449a-b724-7dcda4e284e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[708cf157-18e0-4d84-9768-c0299eedc93f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:32 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7c3609b4-4433-4b9a-bba2-81c86e6c72c4 tempest-GroupSnapshotsTest-830361566 None] Created volume successfully. Apr 29 16:47:32 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 Apr 29 16:47:32 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:32 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48" returned: 0 in 0.759s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:32 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48 Apr 29 16:47:32 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:33 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5" returned: 0 in 0.769s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:33 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 1G Apr 29 16:47:33 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:33 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-22565399-fa7d-4795-95d6-f4d140a90e48" returned: 0 in 0.661s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] GroupSnapshot 3ba6e6ab-bf21-4e77-ab02-d5e5975299a7: creating. Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-22565399-fa7d-4795-95d6-f4d140a90e48" released by "delete_volume" :: held 1.492s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Group snapshot 3ba6e6ab-bf21-4e77-ab02-d5e5975299a7: creating. {{(pid=84201) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Created reservations ['d2bf9e83-1eba-4ea7-8e7b-c44b9c0c82e3', 'b9f8aef5-e555-4621-8bc7-0d5fb3fda249', '059acffc-eac4-44cf-ad16-bda05c0a4ea2', '6aab2068-ed0d-4580-bf52-8641f60c1013'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:33 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:47:33 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:33 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 1G" returned: 0 in 0.756s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:33 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:47:33 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Lock "cinder-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-quobyte-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:33 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.639s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:47:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Deleted volume successfully. Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" acquired by "delete_volume" :: waited 0.029s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[af543824-34c7-4685-8942-ff7ebb35c26a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f25c607b-f667-407f-ab8e-27295e6c362b tempest-VolumesGetTest-562840024 None] Lock "cinder-22565399-fa7d-4795-95d6-f4d140a90e48-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:34 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 Apr 29 16:47:34 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:34 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.650s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:34 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 is being set with open permissions: ugo+rw Apr 29 16:47:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:34 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:47:34 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:34 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" returned: 0 in 0.738s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:34 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3 Apr 29 16:47:34 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:35 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.621s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:35 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.info Apr 29 16:47:35 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:35 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" returned: 0 in 0.605s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3" released by "delete_volume" :: held 1.393s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Created reservations ['90f99b91-d478-49fa-8d38-a304c6fe87fa', '4d130d61-ae02-40e2-b56d-fb013b66f175', 'cce7a8d3-cf1b-477b-ba27-0349e11d9111', '03ad6470-49f2-43e1-aeff-0efe2ac04d2c'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:35 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:47:35 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:35 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.info" returned: 0 in 0.649s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:35 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.info is being set with open permissions: ugo+rw Apr 29 16:47:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:35 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.info Apr 29 16:47:35 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:36 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.657s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:47:36 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Deleted volume successfully. Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3ec4e3f-a91d-4579-9254-f3ce5fddbe8d tempest-VolumesGetTest-562840024 None] Lock "cinder-ecb1f84f-9bf2-477e-a709-6afdf6d1e5b3-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Lock "cinder-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-quobyte-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c43b86b-4c7e-417b-8ab7-0a1ca7b93d7b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:36 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.info" returned: 0 in 0.646s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:36 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 Apr 29 16:47:36 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.210s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.850s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Creating offline snapshot f8d50eb1-327e-48f1-a41e-e00aca66272f of volume 7461c588-6ee9-440a-8799-70b092b8681a {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:47:36 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-4ea52d0c-378a-4033-a6e9-4aeab5e54d85 tempest-SnapshotsActionsTest-852101935 None] Create snapshot completed successfully Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[946b70ae-973e-4a65-bb85-96a6b7c4a9d6]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:36 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a Apr 29 16:47:36 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:37 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" returned: 0 in 0.773s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:37 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3 Apr 29 16:47:37 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:37 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a" returned: 0 in 0.722s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:37 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f 1G Apr 29 16:47:37 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:37 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" returned: 0 in 0.665s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3" released by "delete_volume" :: held 1.511s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Created reservations ['40ab322c-1811-44eb-a510-5394f43b06d7', 'f7a0308e-ce37-4805-9380-654f990781c8', '3a0e0089-b5ff-4f9d-8d09-c8bff9917360', '445a0876-eabc-45eb-926a-0bd8c508791e'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:37 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:47:37 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:38 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f 1G" returned: 0 in 0.901s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7461c588-6ee9-440a-8799-70b092b8681a -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:38 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7461c588-6ee9-440a-8799-70b092b8681a -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f Apr 29 16:47:38 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:38 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.601s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:38 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:47:38 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Deleted volume successfully. Apr 29 16:47:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2a6bd1ac-04f2-4088-b21c-ed47387901d6 tempest-VolumesGetTest-562840024 None] Lock "cinder-b6407d4c-10f5-4cd1-bd04-e0c04a7bb5c3-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:38 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7461c588-6ee9-440a-8799-70b092b8681a -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f" returned: 0 in 0.682s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:38 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f is being set with open permissions: ugo+rw Apr 29 16:47:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:38 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f Apr 29 16:47:38 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (aabd7b67-3b1f-454b-b568-e9aed18db892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55013061-40f1-401d-8c63-54cb2accff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55013061-40f1-401d-8c63-54cb2accff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1449203735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da05011d-ba58-4ed6-b93a-ed31616b791c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:39Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc80d2b-a02a-411a-a9e3-bfac50e6b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc80d2b-a02a-411a-a9e3-bfac50e6b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951c76dc-46cd-40b3-baef-d4ece82b0930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.image.glance [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Creating Keystone auth plugin from conf {{(pid=84201) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 16:47:39 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f" returned: 0 in 0.650s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951c76dc-46cd-40b3-baef-d4ece82b0930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da05011d-ba58-4ed6-b93a-ed31616b791c', 'volume_name': 'volume-da05011d-ba58-4ed6-b93a-ed31616b791c', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e9071-98c8-42dc-a4a7-630686dba54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e9071-98c8-42dc-a4a7-630686dba54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca22e25-991c-4433-827f-92757ffaf60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:39 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Volume da05011d-ba58-4ed6-b93a-ed31616b791c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da05011d-ba58-4ed6-b93a-ed31616b791c', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Trying to clone da05011d-ba58-4ed6-b93a-ed31616b791c from image 41e2d651-26b7-481d-97f0-de8b038b5cd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]). {{(pid=84201) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:39 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.info Apr 29 16:47:39 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 16:47:39 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Image download 20.69 MB at 20.69 MB/s Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[437b146f-7625-4a94-9edf-418783bc0d9d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:39 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD Apr 29 16:47:39 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:40 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.info" returned: 0 in 0.723s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:40 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.info is being set with open permissions: ugo+rw Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:40 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.info Apr 29 16:47:40 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:40 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD" returned: 0 in 0.707s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Temporary image 41e2d651-26b7-481d-97f0-de8b038b5cd4 is fetched for user 73fde59d530841c9981c837318f2bf38. {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10f42d2-ce55-495f-8354-6066e1d39b33]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:40 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD Apr 29 16:47:40 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:40 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.info" returned: 0 in 0.591s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.398s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.658s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Creating offline snapshot 5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 of volume 42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:47:40 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-48c8bed3-3829-468a-b12b-e585e6242794 tempest-SnapshotMetadataTestJSON-1663556856 None] Create snapshot completed successfully Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bfd3a4-a7b1-45fc-9105-aa97cbfed918]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:40 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 Apr 29 16:47:40 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:41 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD" returned: 0 in 0.713s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:41 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Acquiring lock "cinder-f8d50eb1-327e-48f1-a41e-e00aca66272f-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1" returned: 0 in 0.768s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-f8d50eb1-327e-48f1-a41e-e00aca66272f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Acquiring lock "cinder-quobyte-7461c588-6ee9-440a-8799-70b092b8681a" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:41 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 1G Apr 29 16:47:41 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-quobyte-7461c588-6ee9-440a-8799-70b092b8681a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Acquiring lock "cinder-quobyte-f8d50eb1-327e-48f1-a41e-e00aca66272f" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-quobyte-f8d50eb1-327e-48f1-a41e-e00aca66272f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Deleting offline snapshot f8d50eb1-327e-48f1-a41e-e00aca66272f of volume 7461c588-6ee9-440a-8799-70b092b8681a {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] snapshot_file for this snap is: volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[80320f67-7bd9-432f-bef1-7425e8bdf807]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:41 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f Apr 29 16:47:41 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:42 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 1G" returned: 0 in 0.777s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ef85d6-98e9-4a50-a446-74831bc908b1 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:42 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ef85d6-98e9-4a50-a446-74831bc908b1 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 Apr 29 16:47:42 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:42 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f" returned: 0 in 0.736s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7461c588-6ee9-440a-8799-70b092b8681a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:47:42 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21d0044-ecf0-4fea-b54c-71f5f5d610b2]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:42 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a Apr 29 16:47:42 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:43 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ef85d6-98e9-4a50-a446-74831bc908b1 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45" returned: 0 in 0.660s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:43 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:47:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:43 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 Apr 29 16:47:43 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:43 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a" returned: 0 in 0.722s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:43 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f Apr 29 16:47:43 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:43 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45" returned: 0 in 0.613s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:43 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.info Apr 29 16:47:43 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:43 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f" returned: 0 in 0.761s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:43 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f Apr 29 16:47:43 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:44 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.info" returned: 0 in 0.661s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:44 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:44 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.info Apr 29 16:47:44 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:44 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a.f8d50eb1-327e-48f1-a41e-e00aca66272f" returned: 0 in 0.602s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-quobyte-f8d50eb1-327e-48f1-a41e-e00aca66272f" released by "_delete_snapshot" :: held 2.931s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-quobyte-7461c588-6ee9-440a-8799-70b092b8681a" released by "delete_snapshot" :: held 2.958s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Created reservations ['5249af78-bdba-4058-860e-a9288d562742', 'f135f26c-122a-478f-a226-b54abdb222cf', '07420200-ac15-4df0-9208-f1c3e57e37b1', '353ca423-5914-42c9-aeb9-5f9782fe48e0'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:44 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Delete snapshot completed successfully. Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-78575722-cc20-45c4-a68a-7c4aa6c56303 tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-f8d50eb1-327e-48f1-a41e-e00aca66272f-delete_snapshot" released by "delete_snapshot" :: held 3.103s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Acquiring lock "cinder-7461c588-6ee9-440a-8799-70b092b8681a-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-7461c588-6ee9-440a-8799-70b092b8681a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Acquiring lock "cinder-quobyte-7461c588-6ee9-440a-8799-70b092b8681a" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-quobyte-7461c588-6ee9-440a-8799-70b092b8681a" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[60430727-2d2b-4938-9982-907048a952a2]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:45 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.info" returned: 0 in 0.646s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.245s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.207s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Creating offline snapshot 7b0ba864-348b-495e-b707-8a4362b45383 of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:47:45 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a Apr 29 16:47:45 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e62c07-989d-496a-9675-832673f1f917]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:45 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-89b3065e-e2d4-4930-915f-4e27341acc65 tempest-GroupSnapshotsTest-830361566 None] group_snapshot 3ba6e6ab-bf21-4e77-ab02-d5e5975299a7: created successfully Apr 29 16:47:45 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:47:45 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:45 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a" returned: 0 in 0.780s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:45 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a Apr 29 16:47:45 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:45 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.757s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:47:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:45 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 1G Apr 29 16:47:45 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:46 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7461c588-6ee9-440a-8799-70b092b8681a" returned: 0 in 0.608s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-quobyte-7461c588-6ee9-440a-8799-70b092b8681a" released by "delete_volume" :: held 1.459s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Created reservations ['98ca3883-7055-4e07-92b6-8e838d29ad05', 'fd11dbc3-bb66-43ea-8f65-233071c42d0c', '525d1569-2f46-495e-b9aa-207a13e26c4d', 'c26a3dbc-227d-444c-9b77-3a0ca9bea0e0'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:46 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:47:46 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:46 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 1G" returned: 0 in 0.889s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:46 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 Apr 29 16:47:46 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:47 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.656s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:47 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:47:47 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Deleted volume successfully. Apr 29 16:47:47 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-157b560e-2838-4d81-a9aa-1ef8283a264e tempest-SnapshotMetadataTestJSON-1663556856 None] Lock "cinder-7461c588-6ee9-440a-8799-70b092b8681a-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:47 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383" returned: 0 in 0.658s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:47 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 is being set with open permissions: ugo+rw Apr 29 16:47:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:47 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 Apr 29 16:47:47 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:48 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383" returned: 0 in 0.642s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.823s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1449203735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da05011d-ba58-4ed6-b93a-ed31616b791c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:39Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Creating volume da05011d-ba58-4ed6-b93a-ed31616b791c {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:47:48 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:48 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c 1073741824 Apr 29 16:47:48 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:48 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-81686b3d-d534-4a94-abf4-36fa5bd586a6 tempest-SnapshotsActionsTest-852101935 None] Create snapshot completed successfully Apr 29 16:47:48 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c 1073741824" returned: 0 in 0.864s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:49 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c Apr 29 16:47:49 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-7b0ba864-348b-495e-b707-8a4362b45383-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-7b0ba864-348b-495e-b707-8a4362b45383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-quobyte-7b0ba864-348b-495e-b707-8a4362b45383" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-7b0ba864-348b-495e-b707-8a4362b45383" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Deleting offline snapshot 7b0ba864-348b-495e-b707-8a4362b45383 of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] snapshot_file for this snap is: volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a06710-9326-438c-bcd7-3e4509fba8d5]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:49 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 Apr 29 16:47:49 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:49 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c" returned: 0 in 0.625s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.846s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" by "_create_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Creating volume 0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd from snapshot 5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 {{(pid=84201) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Attempting download of 41e2d651-26b7-481d-97f0-de8b038b5cd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}])) to volume da05011d-ba58-4ed6-b93a-ed31616b791c. {{(pid=84201) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] snapshot: 5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45, volume: 0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c42e21d-f505-4429-a71f-c5485aeb0860]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2aa6c6-796f-4e40-bfdd-570ff64bcd27]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_36b1qj99 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:49 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 Apr 29 16:47:49 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:49 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_36b1qj99 Apr 29 16:47:49 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:50 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383" returned: 0 in 1.003s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e983e69f-e740-492e-b218-689daedd31c3]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:50 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45" returned: 0 in 0.812s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ef85d6-98e9-4a50-a446-74831bc908b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:47:50 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_36b1qj99" returned: 0 in 0.799s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_36b1qj99 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7912c5fe-d437-4502-817d-c7ede8a55687]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:50 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:47:50 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:50 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_36b1qj99 Apr 29 16:47:50 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:50 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 Apr 29 16:47:50 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Flow 'volume_create_manager' (1635cdb0-310f-4e58-a775-47fe065194b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6df622-374a-4237-85e4-28f19205bd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6df622-374a-4237-85e4-28f19205bd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1095851182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f90dfa9-a996-4c2e-bffe-35ad58511e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14366781104445386233a98e1899564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:51Z,use_quota=True,user_id='fcf372a0bae44b24bfd863f009cae022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81bc251-04d1-4f77-9b9e-0bfb8e78028c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81bc251-04d1-4f77-9b9e-0bfb8e78028c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7536ca-f4f4-47fd-a6f1-726dfe3630e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7536ca-f4f4-47fd-a6f1-726dfe3630e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f90dfa9-a996-4c2e-bffe-35ad58511e44', 'volume_name': 'volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8703f4a-a052-4c87-8a40-31e827b7f46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8703f4a-a052-4c87-8a40-31e827b7f46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d232433-d809-40a0-915a-4fddecd6a4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:51 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Volume 1f90dfa9-a996-4c2e-bffe-35ad58511e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44', 'volume_size': 1} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:51 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_36b1qj99" returned: 1 in 0.807s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_36b1qj99' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbacc7bf-83d5-4d07-b952-653e03e09284]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:51 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.920s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:51 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1" returned: 0 in 0.843s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:51 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:47:51 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:51 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd Apr 29 16:47:51 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:51 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD Apr 29 16:47:51 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:52 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD" returned: 0 in 0.763s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:52 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] 41e2d651-26b7-481d-97f0-de8b038b5cd4 was qcow2, converting to raw {{(pid=84201) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 16:47:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:52 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383" returned: 0 in 0.766s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:52 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c Apr 29 16:47:52 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:52 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383 Apr 29 16:47:52 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:53 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.7b0ba864-348b-495e-b707-8a4362b45383" returned: 0 in 1.581s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-7b0ba864-348b-495e-b707-8a4362b45383" released by "_delete_snapshot" :: held 4.433s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" released by "delete_snapshot" :: held 4.473s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:54 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Created reservations ['e7ecf6a4-f9b6-4f44-a8e6-6557c9f33d39', 'b66c7578-9e2f-44e5-ac89-01cba9140216', 'e23671be-141d-4e90-a110-f1061bef4bc7', 'cddff09b-bad8-47a8-967e-2bdd82c5aea8'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:47:54 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Delete snapshot completed successfully. Apr 29 16:47:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-066313fe-2acf-4850-b3b5-c940ca997354 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-7b0ba864-348b-495e-b707-8a4362b45383-delete_snapshot" released by "delete_snapshot" :: held 4.862s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:56 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c" returned: 0 in 4.474s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:56 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_e74imt58devstack@QuobyteHD, size 112.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:47:56 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Converted 112.00 MB image at 25.03 MB/s Apr 29 16:47:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:56 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c 1G Apr 29 16:47:56 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:56 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" returned: 0 in 5.390s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:56 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51d8c90-34e1-4ebc-b97b-0624183b057a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:57 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 Apr 29 16:47:57 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:57 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c 1G" returned: 0 in 0.689s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:57 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4da5c92-d9bc-4195-b830-76bd4ae9ff7a]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:57 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c Apr 29 16:47:57 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:57 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1" returned: 0 in 0.899s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:57 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:47:57 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Converted 1024.00 MB image at 189.92 MB/s Apr 29 16:47:57 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:47:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:57 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd Apr 29 16:47:57 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:58 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c" returned: 0 in 0.710s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:58 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c Apr 29 16:47:58 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:58 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" returned: 0 in 0.578s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" released by "_copy_volume_from_snapshot" :: held 8.661s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" released by "_create_volume_from_snapshot" :: held 8.715s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.746s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.269s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1095851182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f90dfa9-a996-4c2e-bffe-35ad58511e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14366781104445386233a98e1899564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:47:51Z,use_quota=True,user_id='fcf372a0bae44b24bfd863f009cae022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Creating volume 1f90dfa9-a996-4c2e-bffe-35ad58511e44 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:47:58 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:58 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 1073741824 Apr 29 16:47:58 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:58 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ea8a4656-0412-4452-b652-dc430a28f4b5 tempest-GroupSnapshotsTest-830361566 None] Create group from source-snapshot-3ba6e6ab-bf21-4e77-ab02-d5e5975299a7 completed successfully. Apr 29 16:47:58 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c" returned: 1 in 0.745s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Downloaded image 41e2d651-26b7-481d-97f0-de8b038b5cd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}])) to volume da05011d-ba58-4ed6-b93a-ed31616b791c successfully. {{(pid=84201) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Temporary image 41e2d651-26b7-481d-97f0-de8b038b5cd4 for user 73fde59d530841c9981c837318f2bf38 is deleted. {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Marking volume da05011d-ba58-4ed6-b93a-ed31616b791c as bootable. {{(pid=84201) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Copying metadata from image 41e2d651-26b7-481d-97f0-de8b038b5cd4 to da05011d-ba58-4ed6-b93a-ed31616b791c. {{(pid=84201) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Creating volume glance metadata for volume da05011d-ba58-4ed6-b93a-ed31616b791c backed by image 41e2d651-26b7-481d-97f0-de8b038b5cd4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84201) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe497f-e5e3-484c-9104-28116ffddee0]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:47:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca22e25-991c-4433-827f-92757ffaf60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da05011d-ba58-4ed6-b93a-ed31616b791c', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af47c7a1-0f74-4c18-95d5-d24d35bd2704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:59 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Volume volume-da05011d-ba58-4ed6-b93a-ed31616b791c (da05011d-ba58-4ed6-b93a-ed31616b791c): created successfully Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af47c7a1-0f74-4c18-95d5-d24d35bd2704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (aabd7b67-3b1f-454b-b568-e9aed18db892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:47:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5b2aa34b-9fb3-440c-bdd1-7433c253a3fb tempest-VolumesGetTest-562840024 None] Created volume successfully. Apr 29 16:47:59 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd Apr 29 16:47:59 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:59 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 1073741824" returned: 0 in 0.823s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:59 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 Apr 29 16:47:59 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:59 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" returned: 0 in 0.710s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:47:59 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd Apr 29 16:47:59 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:47:59 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44" returned: 0 in 0.649s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.188s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d232433-d809-40a0-915a-4fddecd6a4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc5b3ef-dd30-47ae-adc7-2fd550eaac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:47:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Creating offline snapshot 3c33e5c6-d64f-4c73-846e-9d91144c88b7 of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:48:00 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Volume volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 (1f90dfa9-a996-4c2e-bffe-35ad58511e44): created successfully Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc5b3ef-dd30-47ae-adc7-2fd550eaac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Flow 'volume_create_manager' (1635cdb0-310f-4e58-a775-47fe065194b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f924be-4632-4b75-866b-22cb3125b2ba]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:00 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8ab53ebb-7157-4b2e-9eac-877f4b53272f tempest-AbsoluteLimitsTests-2041940069 None] Created volume successfully. Apr 29 16:48:00 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:48:00 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:00 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" returned: 0 in 0.733s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (7e816512-e552-4dec-bdd8-3c7e8c93bb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086944f6-2321-4145-9d7d-9234b3a2a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-0f33f8ac-4d29-4eca-ae10-5ea839d2c5bd" released by "delete_volume" :: held 1.539s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086944f6-2321-4145-9d7d-9234b3a2a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-870278876',display_name='tempest-VolumesGetTest-Volume-142784914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6bed088-8319-42ac-a72e-58e3dfd4dc0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:00Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8b8233-9673-4c73-b521-436893ec04bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8b8233-9673-4c73-b521-436893ec04bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ff35b1-fd92-43ab-b318-8fe3430f36b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ff35b1-fd92-43ab-b318-8fe3430f36b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6bed088-8319-42ac-a72e-58e3dfd4dc0b', 'volume_name': 'volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2c97f8-c0bf-4cb8-8ec8-49be8c41c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2c97f8-c0bf-4cb8-8ec8-49be8c41c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41191446-8c26-443a-b931-b11d431aa68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:00 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Volume f6bed088-8319-42ac-a72e-58e3dfd4dc0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b', 'volume_size': 1} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['73e62bd4-2e23-412b-9c1d-ff751900ef51'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:00 devstack cinder-volume[84201]: WARNING cinder.quota [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1673939269 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1673939269, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:48:00 devstack cinder-volume[84201]: WARNING cinder.quota [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1673939269 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1673939269, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['25a12792-3931-43a5-bd12-4408b6541f06', '7bcd3943-bd60-4b84-9e24-a1021b654cc0', '40da5ea6-cd76-4391-b796-5119f0530fc5', 'acd54d2a-f485-4ab2-baef-32c1b8466074'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:00 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:00 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:00 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.805s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:00 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 1G Apr 29 16:48:00 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Acquiring lock "cinder-1f90dfa9-a996-4c2e-bffe-35ad58511e44-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Lock "cinder-1f90dfa9-a996-4c2e-bffe-35ad58511e44-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Acquiring lock "cinder-quobyte-1f90dfa9-a996-4c2e-bffe-35ad58511e44" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Lock "cinder-quobyte-1f90dfa9-a996-4c2e-bffe-35ad58511e44" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5172136d-1d61-4c66-b5d2-4438f8085710]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:01 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] group_snapshot 3ba6e6ab-bf21-4e77-ab02-d5e5975299a7: deleting Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] group_snapshot 3ba6e6ab-bf21-4e77-ab02-d5e5975299a7: deleting {{(pid=84201) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-42ef85d6-98e9-4a50-a446-74831bc908b1" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-42ef85d6-98e9-4a50-a446-74831bc908b1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Deleting offline snapshot 5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 of volume 42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] snapshot_file for this snap is: volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281bb0f-3a1e-47f9-b426-489eddf5b4a7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:01 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 Apr 29 16:48:01 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:01 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.851s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:01 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-983f0505-57e1-4e9c-9695-fbbc43896a25 tempest-GroupSnapshotsTest-830361566 None] Delete group completed successfully. Apr 29 16:48:01 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 Apr 29 16:48:01 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:01 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 1G" returned: 0 in 0.936s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:01 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 Apr 29 16:48:01 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:02 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44" returned: 0 in 0.892s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:02 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44 Apr 29 16:48:02 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:02 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45" returned: 0 in 0.921s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ef85d6-98e9-4a50-a446-74831bc908b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[25af38e8-821f-491c-a947-ebf2d42cdedc]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:02 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 Apr 29 16:48:02 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:02 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7" returned: 0 in 0.793s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:02 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 is being set with open permissions: ugo+rw Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:02 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 Apr 29 16:48:02 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:02 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f90dfa9-a996-4c2e-bffe-35ad58511e44" returned: 0 in 0.678s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Lock "cinder-quobyte-1f90dfa9-a996-4c2e-bffe-35ad58511e44" released by "delete_volume" :: held 1.637s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Created reservations ['8011a2c3-8c57-4c79-8ab2-5581d3dc6638', 'ab2a20ce-da93-4ec1-905d-376950f45b50', '499657a7-bf0e-4701-bc4c-a4313db3ff84', 'e866cd26-1de0-44e8-9298-fe801e7343ef'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:02 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:02 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:03 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1" returned: 0 in 0.797s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:03 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 Apr 29 16:48:03 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:03 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7" returned: 0 in 0.661s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.378s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.786s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-870278876',display_name='tempest-VolumesGetTest-Volume-142784914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6bed088-8319-42ac-a72e-58e3dfd4dc0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e61ea1859e04f87be9e247061b9cd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:00Z,use_quota=True,user_id='73fde59d530841c9981c837318f2bf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Creating volume f6bed088-8319-42ac-a72e-58e3dfd4dc0b {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:03 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:03 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b 1073741824 Apr 29 16:48:03 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-91e63c39-8786-40aa-a3d5-630873ac796d tempest-SnapshotsActionsTest-852101935 None] Create snapshot completed successfully Apr 29 16:48:03 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.634s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Deleted volume successfully. Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0dcac95-9222-4c06-906c-3d2957f8b9aa tempest-AbsoluteLimitsTests-2041940069 None] Lock "cinder-1f90dfa9-a996-4c2e-bffe-35ad58511e44-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:03 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45" returned: 0 in 0.846s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:04 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45 Apr 29 16:48:04 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-3c33e5c6-d64f-4c73-846e-9d91144c88b7-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-3c33e5c6-d64f-4c73-846e-9d91144c88b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-quobyte-3c33e5c6-d64f-4c73-846e-9d91144c88b7" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-3c33e5c6-d64f-4c73-846e-9d91144c88b7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Deleting offline snapshot 3c33e5c6-d64f-4c73-846e-9d91144c88b7 of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] snapshot_file for this snap is: volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[231b3625-39db-451e-9b04-cb4fed96e37f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:04 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b 1073741824" returned: 0 in 1.061s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:04 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 Apr 29 16:48:04 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:04 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b Apr 29 16:48:04 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:04 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1.5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45" returned: 0 in 0.774s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-5372cfd5-1dd8-4eeb-92a4-e56c5fb53f45" released by "_delete_snapshot" :: held 3.523s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-42ef85d6-98e9-4a50-a446-74831bc908b1" released by "delete_snapshot" :: held 3.567s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:04 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:04 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:05 devstack cinder-volume[84201]: WARNING cinder.quota [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1673939269 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1673939269, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['a490f185-0eb6-4ea2-a50c-5bd2088b6fa5', 'a44daf02-8dfb-4ba7-8f60-30b72d4fb235', '644a0171-2dc4-421f-9673-46bab51e16b3', 'a946017f-cafc-4572-b9ea-18fd34d6d0ab'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:05 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-4c469fd4-9a90-49df-bd93-e39e18eeb893 tempest-GroupSnapshotsTest-830361566 None] group_snapshot 3ba6e6ab-bf21-4e77-ab02-d5e5975299a7: deleted successfully Apr 29 16:48:05 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b" returned: 0 in 0.904s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41191446-8c26-443a-b931-b11d431aa68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bff7c72-811a-4116-8a96-e76e4758528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:05 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Volume volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b (f6bed088-8319-42ac-a72e-58e3dfd4dc0b): created successfully Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bff7c72-811a-4116-8a96-e76e4758528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Flow 'volume_create_manager' (7e816512-e552-4dec-bdd8-3c7e8c93bb4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:05 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ea771167-a021-4161-8452-44d6b989ade1 tempest-VolumesGetTest-562840024 None] Created volume successfully. Apr 29 16:48:05 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7" returned: 0 in 1.107s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf8e0f-ccc0-43b4-96f9-e971a45c1d5b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:05 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:48:05 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:05 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.745s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-42ef85d6-98e9-4a50-a446-74831bc908b1" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-f6bed088-8319-42ac-a72e-58e3dfd4dc0b-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-42ef85d6-98e9-4a50-a446-74831bc908b1" acquired by "delete_volume" :: waited 0.039s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a6e31d-9e15-48e1-aad4-7b233f973574]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Lock "cinder-f6bed088-8319-42ac-a72e-58e3dfd4dc0b-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-quobyte-f6bed088-8319-42ac-a72e-58e3dfd4dc0b" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-f6bed088-8319-42ac-a72e-58e3dfd4dc0b" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:06 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 Apr 29 16:48:06 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d22fa85-3d0d-4fdc-b587-1c3b34575ffc]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:06 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.855s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:06 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 Apr 29 16:48:06 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:06 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b Apr 29 16:48:06 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:06 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1" returned: 0 in 0.834s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:07 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1 Apr 29 16:48:07 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:07 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b" returned: 0 in 0.943s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:07 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7" returned: 0 in 0.942s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:07 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b Apr 29 16:48:07 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:07 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7 Apr 29 16:48:07 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:07 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-42ef85d6-98e9-4a50-a446-74831bc908b1" returned: 0 in 0.735s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-42ef85d6-98e9-4a50-a446-74831bc908b1" released by "delete_volume" :: held 1.653s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['ac50b290-84ee-41e7-9002-91c212ce8dbc'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:07 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f6bed088-8319-42ac-a72e-58e3dfd4dc0b" returned: 0 in 0.684s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-f6bed088-8319-42ac-a72e-58e3dfd4dc0b" released by "delete_volume" :: held 1.702s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:07 devstack cinder-volume[84201]: WARNING cinder.db.sqlalchemy.api [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1673939269'] Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['ab55750a-d125-42cb-99ee-0f65dba4670d', '124eb927-abcf-454e-8530-6522077c0e26', '941e8e00-6abf-44fd-993a-f1882f0e1d73', '09f3530e-3dbb-4185-9b19-bb0e46854cba'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:07 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.3c33e5c6-d64f-4c73-846e-9d91144c88b7" returned: 0 in 0.718s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-3c33e5c6-d64f-4c73-846e-9d91144c88b7" released by "_delete_snapshot" :: held 3.742s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" released by "delete_snapshot" :: held 3.772s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Created reservations ['cf5f6ba4-6fbf-4f27-bc38-e8aa67c78754', '6e4a921c-fdfc-4c05-ade6-20d689c8b9be', '2c767a7c-3e87-48ad-bafa-e7d028d5c564', '282591d9-e505-4eee-9cc7-1a9198a7bfe6'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Created reservations ['52c84a26-29df-4f85-b99f-0e59c62e074f', '544a453b-bc2b-4b06-a7cc-bef89afe222f', 'def8e104-5b4d-4b50-aa56-bae0401a111f', 'a6163971-65a0-4cfc-bf0e-345ab60febf3'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:08 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:08 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:08 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:08 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:08 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Delete snapshot completed successfully. Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8177152-42a3-423d-b901-bfb4c954ed79 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-3c33e5c6-d64f-4c73-846e-9d91144c88b7-delete_snapshot" released by "delete_snapshot" :: held 4.042s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-da05011d-ba58-4ed6-b93a-ed31616b791c-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Lock "cinder-da05011d-ba58-4ed6-b93a-ed31616b791c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Acquiring lock "cinder-quobyte-da05011d-ba58-4ed6-b93a-ed31616b791c" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-da05011d-ba58-4ed6-b93a-ed31616b791c" acquired by "delete_volume" :: waited 0.036s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9116fc-7478-471f-9545-f7e350e991f5]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:09 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c Apr 29 16:48:09 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:09 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-322aaa5a-8a80-48a7-b766-fbb7c54e0b82 tempest-GroupSnapshotsTest-830361566 None] Group tempest-GroupSnapshotsTest-Group-1539751071: creating Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:09 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-322aaa5a-8a80-48a7-b766-fbb7c54e0b82 tempest-GroupSnapshotsTest-830361566 None] Group tempest-GroupSnapshotsTest-Group-1539751071: created successfully Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Creating offline snapshot f3413bb9-c5e7-4cd6-8510-adcd181c5a1b of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:48:09 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.112s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:09 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:09 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-322aaa5a-8a80-48a7-b766-fbb7c54e0b82 tempest-GroupSnapshotsTest-830361566 None] Create group completed successfully. Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.072s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:09 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Deleted volume successfully. Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a2c462-bc7c-4a0b-8ddc-7fcbf1079326]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2dea1be7-40d9-4202-8292-c5e0ea751066 tempest-VolumesGetTest-562840024 None] Lock "cinder-f6bed088-8319-42ac-a72e-58e3dfd4dc0b-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:09 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c1b347ec-8b3a-42e8-b15c-79da7098db92 tempest-GroupSnapshotsTest-830361566 None] Delete group completed successfully. Apr 29 16:48:09 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:48:09 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:09 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c" returned: 0 in 0.958s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:09 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c Apr 29 16:48:09 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:10 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.801s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:10 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b 1G Apr 29 16:48:10 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Flow 'volume_create_manager' (cbd1dc77-6b07-4664-83a1-db623bdfb070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ce1153-89b0-4e4b-880f-83a77cc2c5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ce1153-89b0-4e4b-880f-83a77cc2c5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-875482118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172b8db8-a896-4d46-bec7-9dfa89ce0e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae8bad87fe64f1da295a3b7b4a22ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:10Z,use_quota=True,user_id='1d813dbd5066489a85e6e667cab6b326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047c7836-410c-4c46-911d-bcfe931781f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047c7836-410c-4c46-911d-bcfe931781f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49501548-8d7e-4a69-aa6f-e276c4404279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49501548-8d7e-4a69-aa6f-e276c4404279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172b8db8-a896-4d46-bec7-9dfa89ce0e11', 'volume_name': 'volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e323bba-f214-461b-a14c-e0b61a84a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e323bba-f214-461b-a14c-e0b61a84a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3779195f-b279-4108-aac6-4d70bee165ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Volume 172b8db8-a896-4d46-bec7-9dfa89ce0e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11', 'volume_size': 1} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:10 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c" returned: 1 in 0.851s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:10 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c Apr 29 16:48:10 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Flow 'volume_create_manager' (33bfe765-3120-47e0-a291-f63ce2da6f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d102e7d-eadd-4116-b333-6ac0d2ab5e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d102e7d-eadd-4116-b333-6ac0d2ab5e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1068076092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3008343f-6a85-4155-9060-6efeec29880c,host='devstack@QuobyteHD#QuobyteHD',id=c1299126-2461-43c2-b234-9887bb761f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f907c13f34a4ec087249e7d46bac41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:11Z,use_quota=True,user_id='e661db529ff441c2b44a45eac3735721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(270a7151-0d6a-43e9-bf41-94d2a6434be1),volume_type_id=270a7151-0d6a-43e9-bf41-94d2a6434be1)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7349c862-b48d-42af-bf1a-15f79a5c0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7349c862-b48d-42af-bf1a-15f79a5c0937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3749deed-3dc9-4cc0-87ba-bd7720376a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3749deed-3dc9-4cc0-87ba-bd7720376a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1299126-2461-43c2-b234-9887bb761f7e', 'volume_name': 'volume-c1299126-2461-43c2-b234-9887bb761f7e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7802de-6ca9-4977-b084-b024fd199ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7802de-6ca9-4977-b084-b024fd199ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06e2485-4abb-43a4-a9a9-958f45359eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:10 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Volume c1299126-2461-43c2-b234-9887bb761f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1299126-2461-43c2-b234-9887bb761f7e', 'volume_size': 1} Apr 29 16:48:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:11 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b 1G" returned: 0 in 0.952s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:11 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b Apr 29 16:48:11 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:11 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-da05011d-ba58-4ed6-b93a-ed31616b791c" returned: 0 in 0.711s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Lock "cinder-quobyte-da05011d-ba58-4ed6-b93a-ed31616b791c" released by "delete_volume" :: held 2.613s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Created reservations ['ecbb1fa0-dd5e-4b82-973d-9794c94fa65e', '576b0df7-cde7-4081-ac1e-4706cbb6dd1b', '1e3e7eb4-7225-40dc-9d01-4abf27438e93', 'fd96b0fe-5db3-4bca-ae31-69217f3eb257'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:11 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:11 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:11 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b" returned: 0 in 0.626s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:11 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b is being set with open permissions: ugo+rw Apr 29 16:48:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:11 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b Apr 29 16:48:11 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:12 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.636s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:12 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Deleted volume successfully. Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4c942d2b-f918-49fc-b950-3e6fa9cb47d6 tempest-VolumesGetTest-562840024 None] Lock "cinder-da05011d-ba58-4ed6-b93a-ed31616b791c-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:12 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b" returned: 0 in 0.646s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.170s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.863s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-875482118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172b8db8-a896-4d46-bec7-9dfa89ce0e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae8bad87fe64f1da295a3b7b4a22ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:10Z,use_quota=True,user_id='1d813dbd5066489a85e6e667cab6b326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Creating volume 172b8db8-a896-4d46-bec7-9dfa89ce0e11 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:12 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:12 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 1073741824 Apr 29 16:48:12 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:12 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-16af533a-dfdc-4a9d-a8d5-619dc479b0a2 tempest-SnapshotsActionsTest-852101935 None] Create snapshot completed successfully Apr 29 16:48:13 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 1073741824" returned: 0 in 0.815s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:13 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 Apr 29 16:48:13 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-f3413bb9-c5e7-4cd6-8510-adcd181c5a1b-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-f3413bb9-c5e7-4cd6-8510-adcd181c5a1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-quobyte-f3413bb9-c5e7-4cd6-8510-adcd181c5a1b" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f3413bb9-c5e7-4cd6-8510-adcd181c5a1b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Deleting offline snapshot f3413bb9-c5e7-4cd6-8510-adcd181c5a1b of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] snapshot_file for this snap is: volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3433bac4-cd95-4d69-84fa-31fce39b2fa9]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:13 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b Apr 29 16:48:13 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:13 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11" returned: 0 in 0.655s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.097s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3008343f-6a85-4155-9060-6efeec29880c,created_at=2026-04-29T14:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1068076092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3008343f-6a85-4155-9060-6efeec29880c,host='devstack@QuobyteHD#QuobyteHD',id=c1299126-2461-43c2-b234-9887bb761f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f907c13f34a4ec087249e7d46bac41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:11Z,use_quota=True,user_id='e661db529ff441c2b44a45eac3735721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(270a7151-0d6a-43e9-bf41-94d2a6434be1),volume_type_id=270a7151-0d6a-43e9-bf41-94d2a6434be1)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Creating volume c1299126-2461-43c2-b234-9887bb761f7e {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:13 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3779195f-b279-4108-aac6-4d70bee165ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:13 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e 1073741824 Apr 29 16:48:13 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0c489a-3f9e-414a-9c6c-a50937ee72b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:13 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Volume volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 (172b8db8-a896-4d46-bec7-9dfa89ce0e11): created successfully Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0c489a-3f9e-414a-9c6c-a50937ee72b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Flow 'volume_create_manager' (cbd1dc77-6b07-4664-83a1-db623bdfb070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:14 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-aed77bc0-aba5-4277-a4f9-cb2bc6789665 tempest-VolumesTransfersV355Test-267528994 None] Created volume successfully. Apr 29 16:48:14 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b" returned: 0 in 0.762s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1497ec-3230-43e7-97db-d37fa19b6880]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:14 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:48:14 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:14 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e 1073741824" returned: 0 in 1.006s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:14 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e Apr 29 16:48:14 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Flow 'volume_create_manager' (679fa0f0-ccaa-416a-9e63-d618951cb7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8b4a9f-658c-4dab-8260-3e73b78192d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8b4a9f-658c-4dab-8260-3e73b78192d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2116079545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd09f063-608a-49f1-80ab-f895f04d062b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3b1e3d063e4fa68c32583a6203a0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:15Z,use_quota=True,user_id='2de92475578c4bb19a0dfb4c7fb5c5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3beb3b8e-c032-4a66-915d-684553ff4408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3beb3b8e-c032-4a66-915d-684553ff4408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab679ab1-6046-4be2-aa0c-715a821b4a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab679ab1-6046-4be2-aa0c-715a821b4a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd09f063-608a-49f1-80ab-f895f04d062b', 'volume_name': 'volume-fd09f063-608a-49f1-80ab-f895f04d062b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ac1e7e-beba-4e1b-ad11-b1a73bf3ba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ac1e7e-beba-4e1b-ad11-b1a73bf3ba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746b718d-3774-4161-95d1-39857ee42cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:15 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Volume fd09f063-608a-49f1-80ab-f895f04d062b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd09f063-608a-49f1-80ab-f895f04d062b', 'volume_size': 1} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:15 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.941s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:15 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b Apr 29 16:48:15 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-38784680-9842-4ad5-b89c-896bb24e9340 tempest-VolumesTransfersV355Test-1068901202 None] Transfer volume completed successfully. Apr 29 16:48:15 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e" returned: 0 in 0.704s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2116079545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd09f063-608a-49f1-80ab-f895f04d062b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3b1e3d063e4fa68c32583a6203a0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:15Z,use_quota=True,user_id='2de92475578c4bb19a0dfb4c7fb5c5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Creating volume fd09f063-608a-49f1-80ab-f895f04d062b {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:15 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06e2485-4abb-43a4-a9a9-958f45359eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1299126-2461-43c2-b234-9887bb761f7e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b2e363-72c8-4477-a779-b44ab78f78a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:15 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b 1073741824 Apr 29 16:48:15 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:15 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Volume volume-c1299126-2461-43c2-b234-9887bb761f7e (c1299126-2461-43c2-b234-9887bb761f7e): created successfully Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b2e363-72c8-4477-a779-b44ab78f78a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Flow 'volume_create_manager' (33bfe765-3120-47e0-a291-f63ce2da6f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5753b1df-057f-4e5d-a81b-05bf488aa3af tempest-GroupSnapshotsTest-830361566 None] Created volume successfully. Apr 29 16:48:16 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b" returned: 0 in 0.757s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:16 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b Apr 29 16:48:16 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Acquiring lock "cinder-172b8db8-a896-4d46-bec7-9dfa89ce0e11-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Lock "cinder-172b8db8-a896-4d46-bec7-9dfa89ce0e11-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:16 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b 1073741824" returned: 0 in 0.889s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Acquiring lock "cinder-quobyte-172b8db8-a896-4d46-bec7-9dfa89ce0e11" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Lock "cinder-quobyte-172b8db8-a896-4d46-bec7-9dfa89ce0e11" acquired by "delete_volume" :: waited 0.045s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc564b7-f79d-4b5b-9b3d-7e62414474e6]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:16 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b Apr 29 16:48:16 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Flow 'volume_create_manager' (5aac7b5f-e571-4fb7-a895-4623804d08e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf94e14-15be-4eba-b08a-2d96dc3325b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf94e14-15be-4eba-b08a-2d96dc3325b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892950063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3008343f-6a85-4155-9060-6efeec29880c,host='devstack@QuobyteHD#QuobyteHD',id=a81c0b6e-01d4-453b-a223-56b4c128183c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f907c13f34a4ec087249e7d46bac41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:17Z,use_quota=True,user_id='e661db529ff441c2b44a45eac3735721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(270a7151-0d6a-43e9-bf41-94d2a6434be1),volume_type_id=270a7151-0d6a-43e9-bf41-94d2a6434be1)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e0605-660a-4944-90e3-b0edc3cca84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:16 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 Apr 29 16:48:16 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e0605-660a-4944-90e3-b0edc3cca84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4008a19d-6d98-4814-ba05-62c837917627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4008a19d-6d98-4814-ba05-62c837917627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a81c0b6e-01d4-453b-a223-56b4c128183c', 'volume_name': 'volume-a81c0b6e-01d4-453b-a223-56b4c128183c', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ce94a9-264d-4e2e-bac3-e043e7a2ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ce94a9-264d-4e2e-bac3-e043e7a2ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9cd7f0-177b-44fb-86fe-e840bd4893da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:16 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Volume a81c0b6e-01d4-453b-a223-56b4c128183c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a81c0b6e-01d4-453b-a223-56b4c128183c', 'volume_size': 1} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:16 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f3413bb9-c5e7-4cd6-8510-adcd181c5a1b" returned: 0 in 0.867s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f3413bb9-c5e7-4cd6-8510-adcd181c5a1b" released by "_delete_snapshot" :: held 3.452s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" released by "delete_snapshot" :: held 3.477s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Created reservations ['a61c1088-1186-494f-b0ef-b67f09ea6d3e', 'cb0159e2-e248-4595-9ccb-f65177d65e4e', '03e12d5b-30fc-4388-b558-6a51d7e6c99b', 'e98a3224-c59b-49b7-8c40-ad8165f4e967'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:17 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Delete snapshot completed successfully. Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ce703549-a297-4f51-8599-ea1d9fed8a21 tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-f3413bb9-c5e7-4cd6-8510-adcd181c5a1b-delete_snapshot" released by "delete_snapshot" :: held 3.629s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:17 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b" returned: 0 in 0.672s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3008343f-6a85-4155-9060-6efeec29880c,created_at=2026-04-29T14:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892950063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3008343f-6a85-4155-9060-6efeec29880c,host='devstack@QuobyteHD#QuobyteHD',id=a81c0b6e-01d4-453b-a223-56b4c128183c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f907c13f34a4ec087249e7d46bac41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:17Z,use_quota=True,user_id='e661db529ff441c2b44a45eac3735721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(270a7151-0d6a-43e9-bf41-94d2a6434be1),volume_type_id=270a7151-0d6a-43e9-bf41-94d2a6434be1)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Creating volume a81c0b6e-01d4-453b-a223-56b4c128183c {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:17 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:17 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c 1073741824 Apr 29 16:48:17 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746b718d-3774-4161-95d1-39857ee42cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd09f063-608a-49f1-80ab-f895f04d062b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44ed5a0-e24f-4cf2-91be-ed7aef755709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:17 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Volume volume-fd09f063-608a-49f1-80ab-f895f04d062b (fd09f063-608a-49f1-80ab-f895f04d062b): created successfully Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44ed5a0-e24f-4cf2-91be-ed7aef755709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Flow 'volume_create_manager' (679fa0f0-ccaa-416a-9e63-d618951cb7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:17 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e8028dc8-71c2-449f-a0bb-f0afc2ebb5af tempest-VolumesNegativeTest-88955188 None] Created volume successfully. Apr 29 16:48:17 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11" returned: 0 in 0.868s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:17 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11 Apr 29 16:48:17 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:18 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c 1073741824" returned: 0 in 0.857s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:18 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-172b8db8-a896-4d46-bec7-9dfa89ce0e11" returned: 0 in 0.710s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:18 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c Apr 29 16:48:18 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Lock "cinder-quobyte-172b8db8-a896-4d46-bec7-9dfa89ce0e11" released by "delete_volume" :: held 1.632s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Created reservations ['cd0f5279-20d3-49e6-999d-893c014d5020', '89683506-9520-4f29-9bb8-53d1aff7afab', 'a1e794b2-0224-49d4-9e85-050ebb665517', '3b7c2456-4ce6-4ce1-b3da-6ba9bd0e2c9f'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:18 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:18 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:18 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c" returned: 0 in 0.649s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.846s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Creating offline snapshot 85fdea2a-1814-4048-b441-8fd4599754d8 of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9cd7f0-177b-44fb-86fe-e840bd4893da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a81c0b6e-01d4-453b-a223-56b4c128183c', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc9efa8-10bb-4728-bf2b-2403522db2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7343acaa-3060-4aee-8253-7f0d8a2c5b4a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:19 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Volume volume-a81c0b6e-01d4-453b-a223-56b4c128183c (a81c0b6e-01d4-453b-a223-56b4c128183c): created successfully Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc9efa8-10bb-4728-bf2b-2403522db2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Flow 'volume_create_manager' (5aac7b5f-e571-4fb7-a895-4623804d08e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:19 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e18f1d16-2ed6-4f73-878a-69e725763572 tempest-GroupSnapshotsTest-830361566 None] Created volume successfully. Apr 29 16:48:19 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:48:19 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:19 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.817s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:19 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Deleted volume successfully. Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-297efa67-b8c4-4d4b-964b-cd49f3b89d55 tempest-VolumesTransfersV355Test-1238957894 None] Lock "cinder-172b8db8-a896-4d46-bec7-9dfa89ce0e11-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Flow 'volume_create_manager' (11c54c6b-f32b-41df-b32b-a0c47bc8dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685ccfcc-7a39-4abb-aa9f-c8e4c05be03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685ccfcc-7a39-4abb-aa9f-c8e4c05be03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1002803661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd69b744-fbf0-457d-b9bd-c8bcf2272442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae8bad87fe64f1da295a3b7b4a22ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:19Z,use_quota=True,user_id='1d813dbd5066489a85e6e667cab6b326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002fd323-62c1-4afa-91fe-026cb9375baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002fd323-62c1-4afa-91fe-026cb9375baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12dc9854-c7a2-4cd6-ae56-d960fa7daa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12dc9854-c7a2-4cd6-ae56-d960fa7daa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd69b744-fbf0-457d-b9bd-c8bcf2272442', 'volume_name': 'volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f43cb9-ed30-45bc-8a94-6f0d12cfe2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f43cb9-ed30-45bc-8a94-6f0d12cfe2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edf9193-b172-4d47-b2dd-9979bd389895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:19 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Volume cd69b744-fbf0-457d-b9bd-c8bcf2272442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442', 'volume_size': 1} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:19 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.854s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:19 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 1G Apr 29 16:48:19 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:20 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6e0eb064-4415-4ab2-9e04-be92da31f3ee tempest-GroupSnapshotsTest-830361566 None] Update group completed successfully. Apr 29 16:48:20 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 1G" returned: 0 in 0.829s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:20 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 Apr 29 16:48:20 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:21 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8" returned: 0 in 0.633s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:21 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 is being set with open permissions: ugo+rw Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:21 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 Apr 29 16:48:21 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:21 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-55e99bd4-2b7f-43ef-8c27-8cbd516057e1 tempest-GroupSnapshotsTest-830361566 None] Update group completed successfully. Apr 29 16:48:21 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8" returned: 0 in 0.637s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.115s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.510s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1002803661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd69b744-fbf0-457d-b9bd-c8bcf2272442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae8bad87fe64f1da295a3b7b4a22ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:19Z,use_quota=True,user_id='1d813dbd5066489a85e6e667cab6b326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Creating volume cd69b744-fbf0-457d-b9bd-c8bcf2272442 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:22 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:22 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 1073741824 Apr 29 16:48:22 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:22 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-be11f02e-a36e-4fa9-9c36-3f439d8ad9a4 tempest-SnapshotsActionsTest-852101935 None] Create snapshot completed successfully Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-85fdea2a-1814-4048-b441-8fd4599754d8-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-85fdea2a-1814-4048-b441-8fd4599754d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Acquiring lock "cinder-quobyte-85fdea2a-1814-4048-b441-8fd4599754d8" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-85fdea2a-1814-4048-b441-8fd4599754d8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Deleting offline snapshot 85fdea2a-1814-4048-b441-8fd4599754d8 of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] snapshot_file for this snap is: volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9fe026-f322-464d-a8a6-78b3f9211116]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:22 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 Apr 29 16:48:22 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:22 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-932c7cda-61bc-4565-81cc-afb6d9bc1461 tempest-GroupSnapshotsTest-830361566 None] Update group completed successfully. Apr 29 16:48:22 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 1073741824" returned: 0 in 0.887s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:22 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 Apr 29 16:48:22 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:23 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8" returned: 0 in 0.771s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dfbfff-ade1-4cca-b2d9-b2d320c872bc]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:23 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:48:23 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:23 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442" returned: 0 in 0.613s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edf9193-b172-4d47-b2dd-9979bd389895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d48aa4c-5bd0-4328-932a-8da034f0dc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:23 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Volume volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 (cd69b744-fbf0-457d-b9bd-c8bcf2272442): created successfully Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d48aa4c-5bd0-4328-932a-8da034f0dc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Flow 'volume_create_manager' (11c54c6b-f32b-41df-b32b-a0c47bc8dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:23 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f0baca82-8d7f-4cc8-9fc0-10d2c5d1d9c5 tempest-VolumesTransfersV355Test-267528994 None] Created volume successfully. Apr 29 16:48:23 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-92a046a6-4faf-4cbb-a79e-d51c6044e815 tempest-GroupSnapshotsTest-830361566 None] Update group completed successfully. Apr 29 16:48:24 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.739s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:24 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 Apr 29 16:48:24 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:24 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8" returned: 0 in 0.876s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:24 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8 Apr 29 16:48:24 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Acquiring lock "cinder-cd69b744-fbf0-457d-b9bd-c8bcf2272442-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Lock "cinder-cd69b744-fbf0-457d-b9bd-c8bcf2272442-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Acquiring lock "cinder-quobyte-cd69b744-fbf0-457d-b9bd-c8bcf2272442" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Lock "cinder-quobyte-cd69b744-fbf0-457d-b9bd-c8bcf2272442" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f050d1b-e89f-4b11-ade6-b1274311406f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:25 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 Apr 29 16:48:25 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:25 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] GroupSnapshot 6ec25187-1001-49e3-a952-ee48d4d538fa: creating. Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Group snapshot 6ec25187-1001-49e3-a952-ee48d4d538fa: creating. {{(pid=84201) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Creating offline snapshot 4080e8d2-1e5e-47c0-a1cc-722e7aef84cb of volume c1299126-2461-43c2-b234-9887bb761f7e {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adae6cf-7732-452a-8ba1-952ede41dc22]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:25 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.85fdea2a-1814-4048-b441-8fd4599754d8" returned: 0 in 0.841s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:25 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e Apr 29 16:48:25 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-85fdea2a-1814-4048-b441-8fd4599754d8" released by "_delete_snapshot" :: held 3.379s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" released by "delete_snapshot" :: held 3.412s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=156,cinder:SELECT=160,cinder:INSERT=48,cinder:DELETE=11 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:48:25 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=157,cinder:UPDATE=185,cinder:DELETE=16,cinder:INSERT=43 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:48:26 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Created reservations ['59524fdc-fefb-43e6-b8f7-0ff8a885b77c', 'beb8cf25-a690-4d5b-ad90-25ed43b6f40d', '294214c1-f8d1-4bd9-b630-1eb0ede6f607', '40dc5fb4-79ad-4f69-b5d6-3f8fe4d2cbf5'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:26 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Delete snapshot completed successfully. Apr 29 16:48:26 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5d789788-7994-47fa-ae2a-b679c6a5940c tempest-SnapshotsActionsTest-1624756053 None] Lock "cinder-85fdea2a-1814-4048-b441-8fd4599754d8-delete_snapshot" released by "delete_snapshot" :: held 3.672s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:26 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442" returned: 0 in 1.103s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:26 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442 Apr 29 16:48:26 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:26 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e" returned: 0 in 1.176s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:26 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb 1G Apr 29 16:48:26 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:27 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cd69b744-fbf0-457d-b9bd-c8bcf2272442" returned: 0 in 0.888s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Lock "cinder-quobyte-cd69b744-fbf0-457d-b9bd-c8bcf2272442" released by "delete_volume" :: held 2.071s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Created reservations ['4e3e26b1-c42f-41e4-aee1-224f57758518', 'b7879fe7-892b-4c02-a866-995513f2992b', '43489fdc-d69a-4c46-8d59-53af79f0c5fb', '0b6afbf7-c19f-4380-8df4-0cadef398e8f'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "cinder-f03b724c-cb2b-4906-8613-7ae8f7af71f2-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-f03b724c-cb2b-4906-8613-7ae8f7af71f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "cinder-quobyte-f03b724c-cb2b-4906-8613-7ae8f7af71f2" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-quobyte-f03b724c-cb2b-4906-8613-7ae8f7af71f2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Deleting offline snapshot f03b724c-cb2b-4906-8613-7ae8f7af71f2 of volume f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] snapshot_file for this snap is: volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bbe417-d3ec-41ed-ac84-3a85faed6a59]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:27 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:27 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:27 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:48:27 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:27 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb 1G" returned: 0 in 1.049s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1299126-2461-43c2-b234-9887bb761f7e -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:27 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1299126-2461-43c2-b234-9887bb761f7e -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb Apr 29 16:48:27 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:28 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.694s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:28 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:28 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Deleted volume successfully. Apr 29 16:48:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-92e8778f-01a6-4a7b-b3b2-d807d96409f4 tempest-VolumesTransfersV355Test-1238957894 None] Lock "cinder-cd69b744-fbf0-457d-b9bd-c8bcf2272442-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:28 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.855s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02550cb-432d-4883-ad87-6a51e54d15a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:28 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb94157-a843-45b5-ae76-7b0ec7f2b24e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:28 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 Apr 29 16:48:28 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:28 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1299126-2461-43c2-b234-9887bb761f7e -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb" returned: 0 in 0.721s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:28 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:48:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:28 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb Apr 29 16:48:28 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:29 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5" returned: 0 in 0.746s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:29 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:48:29 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:29 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb" returned: 0 in 0.704s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:29 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.info Apr 29 16:48:29 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:30 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.838s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:30 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.info" returned: 0 in 0.721s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:30 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:30 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2 Apr 29 16:48:30 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:30 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.info Apr 29 16:48:30 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:30 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5.f03b724c-cb2b-4906-8613-7ae8f7af71f2" returned: 0 in 0.763s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:30 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.info" returned: 0 in 0.781s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.278s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-quobyte-f03b724c-cb2b-4906-8613-7ae8f7af71f2" released by "_delete_snapshot" :: held 3.390s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" released by "delete_snapshot" :: held 3.428s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Creating offline snapshot c8564463-5914-4f27-af5d-f68954f7fad0 of volume a81c0b6e-01d4-453b-a223-56b4c128183c {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3dbe79-e045-48cc-8cbb-c37875308825]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:30 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Created reservations ['25f95cce-8851-4dd6-8715-2474a6e77885', '8faa805d-4486-41d2-892e-ae87771d09a8', '46bf63bc-efcc-4556-b5ad-fe9a3f412863', 'd7fef09e-b96a-4184-a6a4-f0f742bca77f'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:31 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Delete snapshot completed successfully. Apr 29 16:48:31 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c Apr 29 16:48:31 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5f7153f6-ba79-4a12-b5d3-611efa2e0cfc tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-f03b724c-cb2b-4906-8613-7ae8f7af71f2-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:31 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "cinder-f02550cb-432d-4883-ad87-6a51e54d15a5-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c" returned: 0 in 0.774s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-f02550cb-432d-4883-ad87-6a51e54d15a5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:31 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 1G Apr 29 16:48:31 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" acquired by "delete_volume" :: waited 0.029s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:31 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[364c15ff-17ba-45a7-9cf9-871e2e5f093a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:32 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 Apr 29 16:48:32 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:32 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5" returned: 0 in 0.772s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:32 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5 Apr 29 16:48:32 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:32 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 1G" returned: 0 in 1.000s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a81c0b6e-01d4-453b-a223-56b4c128183c -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:32 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a81c0b6e-01d4-453b-a223-56b4c128183c -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 Apr 29 16:48:32 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:34 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a81c0b6e-01d4-453b-a223-56b4c128183c -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0" returned: 0 in 1.406s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:34 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:34 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 Apr 29 16:48:34 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:34 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f02550cb-432d-4883-ad87-6a51e54d15a5" returned: 0 in 1.559s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-quobyte-f02550cb-432d-4883-ad87-6a51e54d15a5" released by "delete_volume" :: held 2.427s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Created reservations ['10964600-3ea3-44c2-a908-245a71bddfab', '7e3fdb77-ccea-4a3b-b69f-4197110e0b11', 'a83d74fd-9baf-43a6-ac72-fc1527caf87c', 'bdf072dc-bf51-40f3-a081-47d116e50d06'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:34 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:34 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:34 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0" returned: 0 in 0.718s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:34 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.info Apr 29 16:48:34 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:35 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.095s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Deleted volume successfully. Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90fbd1a3-64f7-49fd-8bc0-2fe84a8b7d7a tempest-SnapshotsActionsTest-852101935 None] Lock "cinder-f02550cb-432d-4883-ad87-6a51e54d15a5-delete_volume" released by "delete_volume" :: held 3.843s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Flow 'volume_create_manager' (54e8c57b-240a-4f37-b5ad-71ae5fd5a2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd0435e-51be-4953-8200-d85fc7258ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd0435e-51be-4953-8200-d85fc7258ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1372239690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bead90fe-b2d4-4fba-b125-22e92d49bccf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='becd1aabdb9c49438b0fd8ab9c0ca693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:36Z,use_quota=True,user_id='0da40537a3fa4db4b69db144d24ee92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433a8a25-4015-4dae-ae85-3c8922b8e79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433a8a25-4015-4dae-ae85-3c8922b8e79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035021a2-b904-4a02-9767-db7bddd2b663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035021a2-b904-4a02-9767-db7bddd2b663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bead90fe-b2d4-4fba-b125-22e92d49bccf', 'volume_name': 'volume-bead90fe-b2d4-4fba-b125-22e92d49bccf', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bc7482-f123-4706-8370-19f96c312a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bc7482-f123-4706-8370-19f96c312a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0019e5ba-29ec-4dfe-a3d1-4d9be71ea401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:36 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Volume bead90fe-b2d4-4fba-b125-22e92d49bccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bead90fe-b2d4-4fba-b125-22e92d49bccf', 'volume_size': 1} Apr 29 16:48:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:36 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.info" returned: 0 in 1.240s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:36 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:48:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:36 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.info Apr 29 16:48:36 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:36 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.info" returned: 0 in 0.859s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.146s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1372239690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bead90fe-b2d4-4fba-b125-22e92d49bccf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='becd1aabdb9c49438b0fd8ab9c0ca693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:36Z,use_quota=True,user_id='0da40537a3fa4db4b69db144d24ee92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Creating volume bead90fe-b2d4-4fba-b125-22e92d49bccf {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:37 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:37 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf 1073741824 Apr 29 16:48:37 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:37 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-86d0e23b-a9b2-4159-a8c3-9c4155b29fbb tempest-GroupSnapshotsTest-830361566 None] group_snapshot 6ec25187-1001-49e3-a952-ee48d4d538fa: created successfully Apr 29 16:48:37 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] group_snapshot 6ec25187-1001-49e3-a952-ee48d4d538fa: deleting Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] group_snapshot 6ec25187-1001-49e3-a952-ee48d4d538fa: deleting {{(pid=84201) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-c1299126-2461-43c2-b234-9887bb761f7e" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-c1299126-2461-43c2-b234-9887bb761f7e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-4080e8d2-1e5e-47c0-a1cc-722e7aef84cb" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-4080e8d2-1e5e-47c0-a1cc-722e7aef84cb" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Deleting offline snapshot 4080e8d2-1e5e-47c0-a1cc-722e7aef84cb of volume c1299126-2461-43c2-b234-9887bb761f7e {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] snapshot_file for this snap is: volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6aa3a9-f9dc-4554-9b1f-99342bbfba4d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:37 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb Apr 29 16:48:37 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:38 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf 1073741824" returned: 0 in 1.310s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:38 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf Apr 29 16:48:38 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:38 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb" returned: 0 in 1.234s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1299126-2461-43c2-b234-9887bb761f7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d44af0b-c8f5-4de0-ba79-1de5e7ade18d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:39 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e Apr 29 16:48:39 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:39 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf" returned: 0 in 1.085s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] <== create_volume: return (2464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.468s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0019e5ba-29ec-4dfe-a3d1-4d9be71ea401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bead90fe-b2d4-4fba-b125-22e92d49bccf', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c624a3ee-7937-4bd2-9f1d-82ab8b75d9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:39 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Volume volume-bead90fe-b2d4-4fba-b125-22e92d49bccf (bead90fe-b2d4-4fba-b125-22e92d49bccf): created successfully Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c624a3ee-7937-4bd2-9f1d-82ab8b75d9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Flow 'volume_create_manager' (54e8c57b-240a-4f37-b5ad-71ae5fd5a2ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:39 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-372c72b1-2bb4-4dfc-9627-f9dc83a9a826 tempest-VolumesListTestJSON-1849897162 None] Created volume successfully. Apr 29 16:48:39 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e" returned: 0 in 0.882s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:39 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb Apr 29 16:48:39 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:40 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb" returned: 0 in 0.924s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:40 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb Apr 29 16:48:40 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:40 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Flow 'volume_create_manager' (704fddc7-a191-4131-8662-099b6ca9ce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1d10f6-c82f-4594-8bfa-5a914db49974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1d10f6-c82f-4594-8bfa-5a914db49974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-531820512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602ac63e-bd15-4be4-9f12-e52fca6cf835,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='becd1aabdb9c49438b0fd8ab9c0ca693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:41Z,use_quota=True,user_id='0da40537a3fa4db4b69db144d24ee92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763b0527-5440-46bc-bd90-b717439f3615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763b0527-5440-46bc-bd90-b717439f3615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099cfa08-38b8-432e-87d5-f4e940ef518c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099cfa08-38b8-432e-87d5-f4e940ef518c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602ac63e-bd15-4be4-9f12-e52fca6cf835', 'volume_name': 'volume-602ac63e-bd15-4be4-9f12-e52fca6cf835', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d5214a-6170-43e0-bee6-39695364827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d5214a-6170-43e0-bee6-39695364827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773ef413-8460-4bdb-9484-79b3b64aa274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:41 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Volume 602ac63e-bd15-4be4-9f12-e52fca6cf835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602ac63e-bd15-4be4-9f12-e52fca6cf835', 'volume_size': 1} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-531820512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602ac63e-bd15-4be4-9f12-e52fca6cf835,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='becd1aabdb9c49438b0fd8ab9c0ca693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:41Z,use_quota=True,user_id='0da40537a3fa4db4b69db144d24ee92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Creating volume 602ac63e-bd15-4be4-9f12-e52fca6cf835 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:41 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:41 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 1073741824 Apr 29 16:48:41 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:41 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e.4080e8d2-1e5e-47c0-a1cc-722e7aef84cb" returned: 0 in 0.684s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-4080e8d2-1e5e-47c0-a1cc-722e7aef84cb" released by "_delete_snapshot" :: held 3.898s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-c1299126-2461-43c2-b234-9887bb761f7e" released by "delete_snapshot" :: held 3.935s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-a81c0b6e-01d4-453b-a223-56b4c128183c" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-a81c0b6e-01d4-453b-a223-56b4c128183c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-c8564463-5914-4f27-af5d-f68954f7fad0" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-c8564463-5914-4f27-af5d-f68954f7fad0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Deleting offline snapshot c8564463-5914-4f27-af5d-f68954f7fad0 of volume a81c0b6e-01d4-453b-a223-56b4c128183c {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] snapshot_file for this snap is: volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68b34c3-0f9b-460a-8e35-ff42b996c3f9]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:41 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 Apr 29 16:48:41 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:42 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 1073741824" returned: 0 in 0.988s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:42 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 Apr 29 16:48:42 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:42 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0" returned: 0 in 0.785s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a81c0b6e-01d4-453b-a223-56b4c128183c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[517b887d-3f31-487d-939a-eecf580b0608]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:42 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c Apr 29 16:48:42 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:42 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835" returned: 0 in 0.614s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773ef413-8460-4bdb-9484-79b3b64aa274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602ac63e-bd15-4be4-9f12-e52fca6cf835', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a3e5b8-9c59-4f58-9809-f6bbba6944d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:42 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Volume volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 (602ac63e-bd15-4be4-9f12-e52fca6cf835): created successfully Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a3e5b8-9c59-4f58-9809-f6bbba6944d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Flow 'volume_create_manager' (704fddc7-a191-4131-8662-099b6ca9ce40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:42 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-a75085bf-c9a9-420f-a881-c7f5930eaee2 tempest-VolumesListTestJSON-1849897162 None] Created volume successfully. Apr 29 16:48:43 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c" returned: 0 in 0.802s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:43 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 Apr 29 16:48:43 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Flow 'volume_create_manager' (7d99b1d5-d5b1-4235-9e2e-b31dc99a6985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dd19eb-7a61-4cf1-9319-f3699206d125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dd19eb-7a61-4cf1-9319-f3699206d125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-362000260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdffda86-2116-4a08-9568-04e1e49d83fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='becd1aabdb9c49438b0fd8ab9c0ca693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:44Z,use_quota=True,user_id='0da40537a3fa4db4b69db144d24ee92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa5d97d-cf66-47d1-8201-24fe6be98712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa5d97d-cf66-47d1-8201-24fe6be98712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ad6bb5-2ed3-443a-b1d4-58941e1d884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ad6bb5-2ed3-443a-b1d4-58941e1d884f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdffda86-2116-4a08-9568-04e1e49d83fc', 'volume_name': 'volume-cdffda86-2116-4a08-9568-04e1e49d83fc', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10c2874-267a-4a8e-be2d-30bc92168155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10c2874-267a-4a8e-be2d-30bc92168155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcadb016-4dba-43ba-ad7f-2f53ec37568f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:43 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Volume cdffda86-2116-4a08-9568-04e1e49d83fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdffda86-2116-4a08-9568-04e1e49d83fc', 'volume_size': 1} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-362000260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdffda86-2116-4a08-9568-04e1e49d83fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='becd1aabdb9c49438b0fd8ab9c0ca693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:44Z,use_quota=True,user_id='0da40537a3fa4db4b69db144d24ee92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Creating volume cdffda86-2116-4a08-9568-04e1e49d83fc {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:43 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:43 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc 1073741824 Apr 29 16:48:43 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:44 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0" returned: 0 in 0.852s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:44 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0 Apr 29 16:48:44 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:44 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c.c8564463-5914-4f27-af5d-f68954f7fad0" returned: 0 in 0.706s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:44 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc 1073741824" returned: 0 in 1.114s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-c8564463-5914-4f27-af5d-f68954f7fad0" released by "_delete_snapshot" :: held 3.267s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-a81c0b6e-01d4-453b-a223-56b4c128183c" released by "delete_snapshot" :: held 3.303s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:45 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc Apr 29 16:48:45 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:45 devstack cinder-volume[84201]: WARNING cinder.quota [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2095456371 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2095456371, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:48:45 devstack cinder-volume[84201]: WARNING cinder.quota [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2095456371 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2095456371, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:48:45 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['4c7ecd39-608a-45fd-84bb-7c3dab639cef', '8f74c37f-09de-41f9-a55d-005d9ec29c30', '8c68cc46-a6e4-4b88-95c7-db397dbeb4f6', '09b24062-3e97-491b-bf05-79126e7e038f'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:45 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['2f941859-0f87-4cd0-b6f6-7a39fe4a3a38', '1b91f9e3-c8d0-4f6b-8d75-2d68e989d473', '5b03d472-e695-4e06-959d-d6fcf186d790', '53c7ab9e-b417-4929-82c0-697afee6540e'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:45 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-fc9273b4-2226-4719-ab41-d01104117847 tempest-GroupSnapshotsTest-830361566 None] group_snapshot 6ec25187-1001-49e3-a952-ee48d4d538fa: deleted successfully Apr 29 16:48:45 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc" returned: 0 in 0.718s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcadb016-4dba-43ba-ad7f-2f53ec37568f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdffda86-2116-4a08-9568-04e1e49d83fc', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b2315d-9f4d-4347-a3ae-820936ea5c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:45 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Volume volume-cdffda86-2116-4a08-9568-04e1e49d83fc (cdffda86-2116-4a08-9568-04e1e49d83fc): created successfully Apr 29 16:48:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b2315d-9f4d-4347-a3ae-820936ea5c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Flow 'volume_create_manager' (7d99b1d5-d5b1-4235-9e2e-b31dc99a6985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:45 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-db09d6b4-a841-4961-bbb7-6f24b984d5f5 tempest-VolumesListTestJSON-1849897162 None] Created volume successfully. Apr 29 16:48:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-a81c0b6e-01d4-453b-a223-56b4c128183c" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-a81c0b6e-01d4-453b-a223-56b4c128183c" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:46 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[700de0ab-8eab-475a-b012-a9a7d9cc5270]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:46 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c Apr 29 16:48:46 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:47 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c" returned: 0 in 0.924s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:47 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c Apr 29 16:48:47 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:48 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a81c0b6e-01d4-453b-a223-56b4c128183c" returned: 0 in 0.839s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-a81c0b6e-01d4-453b-a223-56b4c128183c" released by "delete_volume" :: held 1.856s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-c1299126-2461-43c2-b234-9887bb761f7e" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-c1299126-2461-43c2-b234-9887bb761f7e" acquired by "delete_volume" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:48 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[20432ed9-a57e-4b48-8d07-7ad77008c108]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:48 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e Apr 29 16:48:48 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "cinder-cdffda86-2116-4a08-9568-04e1e49d83fc-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-cdffda86-2116-4a08-9568-04e1e49d83fc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "cinder-quobyte-cdffda86-2116-4a08-9568-04e1e49d83fc" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-quobyte-cdffda86-2116-4a08-9568-04e1e49d83fc" acquired by "delete_volume" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:49 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2fd784-eb08-4e27-ab77-6b24002137b1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:49 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc Apr 29 16:48:49 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:49 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e" returned: 0 in 1.029s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:49 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e Apr 29 16:48:49 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:50 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc" returned: 0 in 0.881s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:50 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc Apr 29 16:48:50 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:50 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c1299126-2461-43c2-b234-9887bb761f7e" returned: 0 in 0.712s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-c1299126-2461-43c2-b234-9887bb761f7e" released by "delete_volume" :: held 1.857s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['c776e3e0-e462-4ca0-85b8-27dd45f89b4e'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:50 devstack cinder-volume[84201]: WARNING cinder.quota [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2095456371 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2095456371, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['53d2b92b-ab71-45f2-86e9-33820e0c2495', 'd0ca76c1-7104-49e0-b356-4aa0e5733bdb', 'f74ce47f-6d1d-41ee-9351-2e00c2a6e6ca', '998a404e-733f-44fc-9d04-c4b9d400f2ff'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['98a37a13-3303-47a2-a761-24cf16b23fb8', 'b9eb12de-dfa0-44aa-b8ad-0725f1aea032', '8ef86c5b-9d43-4318-a637-ffea601b021d', 'f3d6e5e9-f6c7-4b05-8577-7a5894115db3'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:50 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:50 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:51 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-cdffda86-2116-4a08-9568-04e1e49d83fc" returned: 0 in 0.870s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-quobyte-cdffda86-2116-4a08-9568-04e1e49d83fc" released by "delete_volume" :: held 1.817s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Created reservations ['4a5ecb29-fb4a-41be-a476-44fa75c96991', '881c8469-d864-4485-ac15-b95fa25aa1b4', 'ec939029-21a8-4616-8056-8c03c8d43fd2', '75962272-b4b0-4393-965f-c2524974964b'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:51 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:51 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "cinder-602ac63e-bd15-4be4-9f12-e52fca6cf835-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-602ac63e-bd15-4be4-9f12-e52fca6cf835-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "cinder-quobyte-602ac63e-bd15-4be4-9f12-e52fca6cf835" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-quobyte-602ac63e-bd15-4be4-9f12-e52fca6cf835" acquired by "delete_volume" :: waited 0.031s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:51 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.886s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:51 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-51d7601e-cb64-49d1-bde3-86ee848759b9 tempest-GroupSnapshotsTest-830361566 None] Delete group completed successfully. Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4683d41-7f85-4b12-a3ae-c59f05324a3a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-92eea4ca-e09b-46f4-9c90-9692981c0008 tempest-GroupSnapshotsTest-830361566 None] Group tempest-GroupSnapshotsTest-Group-1466694268: creating Apr 29 16:48:52 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 Apr 29 16:48:52 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-92eea4ca-e09b-46f4-9c90-9692981c0008 tempest-GroupSnapshotsTest-830361566 None] Group tempest-GroupSnapshotsTest-Group-1466694268: created successfully Apr 29 16:48:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-92eea4ca-e09b-46f4-9c90-9692981c0008 tempest-GroupSnapshotsTest-830361566 None] Create group completed successfully. Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Acquiring lock "cinder-fd09f063-608a-49f1-80ab-f895f04d062b-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Lock "cinder-fd09f063-608a-49f1-80ab-f895f04d062b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Acquiring lock "cinder-quobyte-fd09f063-608a-49f1-80ab-f895f04d062b" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Lock "cinder-quobyte-fd09f063-608a-49f1-80ab-f895f04d062b" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:52 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.071s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Deleted volume successfully. Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e600ca-bd3a-4c37-96f7-59b05e07d1d2]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c3abbbbe-295d-4ce7-b668-5f902943397b tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-cdffda86-2116-4a08-9568-04e1e49d83fc-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:52 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b Apr 29 16:48:52 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:52 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835" returned: 0 in 0.970s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:52 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835 Apr 29 16:48:52 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:53 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b" returned: 0 in 0.874s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:53 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b Apr 29 16:48:53 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:53 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-602ac63e-bd15-4be4-9f12-e52fca6cf835" returned: 0 in 0.767s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-quobyte-602ac63e-bd15-4be4-9f12-e52fca6cf835" released by "delete_volume" :: held 1.841s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Created reservations ['d6fd3a55-ecf2-49dc-9c57-c972145c0eeb', '6a74c044-1ef9-4e10-88c2-dbe0d9fc0c8f', 'b0e310ed-ec37-458d-96b9-5c6eb381c8da', '12b3a4c4-d885-4780-a59b-016ebe283673'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Flow 'volume_create_manager' (583f08cd-363f-4bf0-99d2-352147cc8a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd7ce2b-09ed-4394-bab0-57512cca5fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd7ce2b-09ed-4394-bab0-57512cca5fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1471152392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ba9172e-b291-44d9-80a1-31ebc4bf25c6,host='devstack@QuobyteHD#QuobyteHD',id=93a30c72-6a85-4fe7-a033-432b1c8a45e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f907c13f34a4ec087249e7d46bac41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:54Z,use_quota=True,user_id='e661db529ff441c2b44a45eac3735721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ef6eef-55f2-4154-a6c1-6a99c0606011),volume_type_id=16ef6eef-55f2-4154-a6c1-6a99c0606011)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5608d594-d9ae-4765-ac02-2b3f48009b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5608d594-d9ae-4765-ac02-2b3f48009b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2ba2e1-94b3-4676-a598-78297015bfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2ba2e1-94b3-4676-a598-78297015bfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a30c72-6a85-4fe7-a033-432b1c8a45e7', 'volume_name': 'volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ae57aa-dd71-4fc4-bb2e-7b2641599ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ae57aa-dd71-4fc4-bb2e-7b2641599ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a9ee97-a058-4329-93cc-cefa135913a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:53 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Volume 93a30c72-6a85-4fe7-a033-432b1c8a45e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7', 'volume_size': 1} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ba9172e-b291-44d9-80a1-31ebc4bf25c6,created_at=2026-04-29T14:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1471152392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ba9172e-b291-44d9-80a1-31ebc4bf25c6,host='devstack@QuobyteHD#QuobyteHD',id=93a30c72-6a85-4fe7-a033-432b1c8a45e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f907c13f34a4ec087249e7d46bac41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:54Z,use_quota=True,user_id='e661db529ff441c2b44a45eac3735721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ef6eef-55f2-4154-a6c1-6a99c0606011),volume_type_id=16ef6eef-55f2-4154-a6c1-6a99c0606011)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Creating volume 93a30c72-6a85-4fe7-a033-432b1c8a45e7 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:53 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:53 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 1073741824 Apr 29 16:48:53 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:54 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:54 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:54 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-fd09f063-608a-49f1-80ab-f895f04d062b" returned: 0 in 0.824s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Lock "cinder-quobyte-fd09f063-608a-49f1-80ab-f895f04d062b" released by "delete_volume" :: held 1.779s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "cinder-bead90fe-b2d4-4fba-b125-22e92d49bccf-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Created reservations ['125382ba-cac5-4ab4-af58-20c558453af7', 'ad0008b1-b9b4-452b-9993-a2123612ee81', '1e03b689-4585-4662-962a-30ed1d2149e0', 'd018da9c-9453-4a2c-90e3-767515665d90'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-bead90fe-b2d4-4fba-b125-22e92d49bccf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "cinder-quobyte-bead90fe-b2d4-4fba-b125-22e92d49bccf" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-quobyte-bead90fe-b2d4-4fba-b125-22e92d49bccf" acquired by "delete_volume" :: waited 0.038s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae45a61-83bf-4a16-913c-b9d196e9af57]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:54 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:54 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:54 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf Apr 29 16:48:54 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:54 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.857s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:54 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Deleted volume successfully. Apr 29 16:48:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d3b5fc3f-d50a-4be5-829e-067b0762260e tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-602ac63e-bd15-4be4-9f12-e52fca6cf835-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:55 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 1073741824" returned: 0 in 1.414s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:55 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.948s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:55 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:55 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Deleted volume successfully. Apr 29 16:48:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3330572c-5ab8-4a60-8b06-47d191fd85d4 tempest-VolumesNegativeTest-88955188 None] Lock "cinder-fd09f063-608a-49f1-80ab-f895f04d062b-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:55 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 Apr 29 16:48:55 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:55 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf" returned: 0 in 1.266s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:55 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf Apr 29 16:48:55 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:56 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7" returned: 0 in 0.793s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] <== create_volume: return (2277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a9ee97-a058-4329-93cc-cefa135913a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc26da2-019f-44ce-a8a1-f1b74f4e477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:56 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Volume volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 (93a30c72-6a85-4fe7-a033-432b1c8a45e7): created successfully Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc26da2-019f-44ce-a8a1-f1b74f4e477b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Flow 'volume_create_manager' (583f08cd-363f-4bf0-99d2-352147cc8a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:56 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-033c52ac-55c8-4cc6-a5a0-6b196661cba7 tempest-GroupSnapshotsTest-830361566 None] Created volume successfully. Apr 29 16:48:56 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bead90fe-b2d4-4fba-b125-22e92d49bccf" returned: 0 in 0.729s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-quobyte-bead90fe-b2d4-4fba-b125-22e92d49bccf" released by "delete_volume" :: held 2.085s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Created reservations ['933117b2-85e6-4a93-8be4-11f9e7328ed0', 'c9d548d5-d32d-4a3c-b83c-cc2083014c71', '8797ee76-c197-4e37-87c4-59a6f8c1bf0e', '56f54e1c-c929-4295-b185-1e86dd6cd31d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:56 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:48:56 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:57 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.665s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:48:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Deleted volume successfully. Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a4d7d53e-09f1-4f91-8cba-d92cb3433f6a tempest-VolumesListTestJSON-1849897162 None] Lock "cinder-bead90fe-b2d4-4fba-b125-22e92d49bccf-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Flow 'volume_create_manager' (58aa1a13-4cf5-4cd6-8be4-ef4db8183c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5f4e87-d4da-4b7e-b7e6-79eabd5a0da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] GroupSnapshot e0eeb73b-8072-4c73-bde5-1989042fe374: creating. Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5f4e87-d4da-4b7e-b7e6-79eabd5a0da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1000671518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b2e43-c524-4f76-972e-2236dd7d316b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acccdc06b42f46578d9af870b8dabd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:58Z,use_quota=True,user_id='1a01d7687c9945eb8f097fa64a0a8352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e8f196-a3ad-44b9-9856-1c0e42aafe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e8f196-a3ad-44b9-9856-1c0e42aafe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7508cd6-1eb8-421e-98c6-a4d1ea2b9207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7508cd6-1eb8-421e-98c6-a4d1ea2b9207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03b2e43-c524-4f76-972e-2236dd7d316b', 'volume_name': 'volume-f03b2e43-c524-4f76-972e-2236dd7d316b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab10b3e-3231-4948-858e-c0e0838f5cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab10b3e-3231-4948-858e-c0e0838f5cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d524b0d-398c-4771-a5b4-b542d12deadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:57 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Volume f03b2e43-c524-4f76-972e-2236dd7d316b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03b2e43-c524-4f76-972e-2236dd7d316b', 'volume_size': 1} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1000671518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b2e43-c524-4f76-972e-2236dd7d316b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acccdc06b42f46578d9af870b8dabd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:58Z,use_quota=True,user_id='1a01d7687c9945eb8f097fa64a0a8352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Creating volume f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:48:57 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Group snapshot e0eeb73b-8072-4c73-bde5-1989042fe374: creating. {{(pid=84201) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 16:48:57 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b 1073741824 Apr 29 16:48:57 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Flow 'volume_create_manager' (6295eea2-ff7a-4068-ba03-8b1bf4694574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b36b43-ba6c-4cfb-813a-2d043b8499b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b36b43-ba6c-4cfb-813a-2d043b8499b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-439162687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74925f15d96469088969585d929ed49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:58Z,use_quota=True,user_id='9e4ead153c2d4a74bb19ca33a40d6492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca2bb11-b80c-486d-9579-a1bacf324f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca2bb11-b80c-486d-9579-a1bacf324f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4669d14b-c1d4-49bf-80d3-599c797340e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4669d14b-c1d4-49bf-80d3-599c797340e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e', 'volume_name': 'volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050c646e-fc59-4f1d-95b5-dc08d3808783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050c646e-fc59-4f1d-95b5-dc08d3808783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def4cce6-5da4-4268-9a08-afd9c0ade678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:58 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Volume 1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e', 'volume_size': 1} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:48:58 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b 1073741824" returned: 0 in 0.874s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:58 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b Apr 29 16:48:58 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:48:59 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b" returned: 0 in 0.626s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.519s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d524b0d-398c-4771-a5b4-b542d12deadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03b2e43-c524-4f76-972e-2236dd7d316b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b6d1a7-62d9-4b72-bf06-d4ab687feaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Creating offline snapshot 8d067a58-b041-4107-9dfe-3be3391536b1 of volume 93a30c72-6a85-4fe7-a033-432b1c8a45e7 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:48:59 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Volume volume-f03b2e43-c524-4f76-972e-2236dd7d316b (f03b2e43-c524-4f76-972e-2236dd7d316b): created successfully Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b6d1a7-62d9-4b72-bf06-d4ab687feaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Flow 'volume_create_manager' (58aa1a13-4cf5-4cd6-8be4-ef4db8183c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[189abef3-44e5-448a-8840-07447be14947]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:48:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:48:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-df1d378e-bf52-4212-bbe1-92e65a0e9d8b tempest-VolumesSnapshotListTestJSON-1327953025 None] Created volume successfully. Apr 29 16:48:59 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 Apr 29 16:48:59 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:00 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7" returned: 0 in 0.821s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:00 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 1G Apr 29 16:49:00 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (6fad5ed2-915d-4bbd-8dbe-15fa9281f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d140ab8a-ba21-45be-b2ec-b8a97fc9a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d140ab8a-ba21-45be-b2ec-b8a97fc9a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-841889132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0ab24c-5364-49d1-be73-412ccb1acc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:01Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ceb5085-a26a-46cb-b5e7-35f782f29a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ceb5085-a26a-46cb-b5e7-35f782f29a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875dc7ea-c670-4025-8f22-f36fe7b71156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875dc7ea-c670-4025-8f22-f36fe7b71156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d0ab24c-5364-49d1-be73-412ccb1acc2e', 'volume_name': 'volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fff1850-67ef-4e0b-8026-a2ea02b1efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fff1850-67ef-4e0b-8026-a2ea02b1efce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e137ca-2b82-4081-b20e-cd00bebbcea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:00 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume 0d0ab24c-5364-49d1-be73-412ccb1acc2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e', 'volume_size': 1} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:00 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 1G" returned: 0 in 0.761s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:00 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 Apr 29 16:49:00 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:01 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1" returned: 0 in 0.636s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:01 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:49:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:01 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 Apr 29 16:49:01 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:02 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1" returned: 0 in 0.640s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:02 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.info Apr 29 16:49:02 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:02 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.info" returned: 0 in 0.621s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:02 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:49:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:02 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.info Apr 29 16:49:02 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:03 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.info" returned: 0 in 0.635s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.237s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.004s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-439162687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74925f15d96469088969585d929ed49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:48:58Z,use_quota=True,user_id='9e4ead153c2d4a74bb19ca33a40d6492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Creating volume 1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:03 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:03 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e 1073741824 Apr 29 16:49:03 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8e4f3fd2-bf74-445f-bcbe-578eb664850f tempest-GroupSnapshotsTest-830361566 None] group_snapshot e0eeb73b-8072-4c73-bde5-1989042fe374: created successfully Apr 29 16:49:04 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] group_snapshot e0eeb73b-8072-4c73-bde5-1989042fe374: deleting Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] group_snapshot e0eeb73b-8072-4c73-bde5-1989042fe374: deleting {{(pid=84201) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-93a30c72-6a85-4fe7-a033-432b1c8a45e7" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-93a30c72-6a85-4fe7-a033-432b1c8a45e7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-8d067a58-b041-4107-9dfe-3be3391536b1" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-8d067a58-b041-4107-9dfe-3be3391536b1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Deleting offline snapshot 8d067a58-b041-4107-9dfe-3be3391536b1 of volume 93a30c72-6a85-4fe7-a033-432b1c8a45e7 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] snapshot_file for this snap is: volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b18959-2e39-4d7f-8c7c-db1914192678]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:04 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 Apr 29 16:49:04 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:04 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e 1073741824" returned: 0 in 0.858s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:04 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e Apr 29 16:49:04 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:04 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:04 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:04 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1" returned: 0 in 0.776s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f32cc4-858f-4ee9-a81d-e70e30711e23]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:05 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e" returned: 0 in 0.651s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.976s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Creating offline snapshot 3503e405-9ced-4f53-b4b5-80af94af6c9a of volume f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def4cce6-5da4-4268-9a08-afd9c0ade678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322e4a2b-eb65-4b06-9cf0-56a48af6c554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[960b7488-4a72-46c0-a4ad-9195463d5059]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:05 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 Apr 29 16:49:05 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:05 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Volume volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e (1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e): created successfully Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322e4a2b-eb65-4b06-9cf0-56a48af6c554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Flow 'volume_create_manager' (6295eea2-ff7a-4068-ba03-8b1bf4694574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:05 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-de5a1847-aedc-4f79-bc4f-1e544c17b5da tempest-VolumeQuotasAdminTestJSON-1844595900 None] Created volume successfully. Apr 29 16:49:05 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b Apr 29 16:49:05 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:05 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.684s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:05 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7" returned: 0 in 0.731s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:05 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 Apr 29 16:49:05 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Acquiring lock "cinder-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "cinder-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:05 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b" returned: 0 in 0.852s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:06 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a 1G Apr 29 16:49:06 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Acquiring lock "cinder-quobyte-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "cinder-quobyte-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8092289c-430c-41b7-8ea6-2c5a7dd13e99]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:06 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e Apr 29 16:49:06 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:06 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1" returned: 0 in 0.787s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:06 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1 Apr 29 16:49:06 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:06 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a 1G" returned: 0 in 0.777s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03b2e43-c524-4f76-972e-2236dd7d316b -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:06 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03b2e43-c524-4f76-972e-2236dd7d316b -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a Apr 29 16:49:06 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:06 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e" returned: 0 in 0.793s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:06 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e Apr 29 16:49:06 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:07 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7.8d067a58-b041-4107-9dfe-3be3391536b1" returned: 0 in 0.647s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-8d067a58-b041-4107-9dfe-3be3391536b1" released by "_delete_snapshot" :: held 3.073s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-93a30c72-6a85-4fe7-a033-432b1c8a45e7" released by "delete_snapshot" :: held 3.099s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:07 devstack cinder-volume[84201]: WARNING cinder.quota [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-615745250 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-615745250, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:49:07 devstack cinder-volume[84201]: WARNING cinder.quota [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-615745250 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-615745250, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['751bddd3-a1c5-4bcc-9e0c-25ccb68536f7', '95979e5f-72a4-4fb1-8220-5891860f6ae0', '47bc370e-6266-4978-943a-32398b7cb475', 'ead0e6f4-86ba-4cc4-a44b-e71549b7481e'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-45937fca-0122-4052-99b4-b8f4100a2e55 tempest-GroupSnapshotsTest-830361566 None] group_snapshot e0eeb73b-8072-4c73-bde5-1989042fe374: deleted successfully Apr 29 16:49:07 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03b2e43-c524-4f76-972e-2236dd7d316b -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a" returned: 0 in 0.702s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:07 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a is being set with open permissions: ugo+rw Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:07 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:07 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a Apr 29 16:49:07 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e" returned: 0 in 0.633s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "cinder-quobyte-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e" released by "delete_volume" :: held 1.469s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Created reservations ['4f658b29-80e5-462f-8a22-0841cdc30548', 'ae950c4f-abd7-4178-9876-0869537c447b', 'b8593c35-aa36-4bf9-b87b-83e42a47c0a9', '91e717ac-dd3e-4fc6-991c-0877f6e6b6eb'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:07 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:07 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:08 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a" returned: 0 in 0.602s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:08 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.info Apr 29 16:49:08 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:08 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.607s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:08 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Deleted volume successfully. Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-326dff7f-0612-4e7d-9b6f-d695c94da556 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "cinder-1e6a2068-252f-4fc7-82b9-ff4a55b4ae6e-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "cinder-quobyte-93a30c72-6a85-4fe7-a033-432b1c8a45e7" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Flow 'volume_create_manager' (df0fcb18-3b9f-461a-bffd-f5e10f445d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810d82eb-6f03-415e-bf4d-a6ba81b3f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:08 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-93a30c72-6a85-4fe7-a033-432b1c8a45e7" acquired by "delete_volume" :: waited 0.053s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810d82eb-6f03-415e-bf4d-a6ba81b3f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1132934896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd65a36e-5a54-4061-a708-c14d99ee7739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74925f15d96469088969585d929ed49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:09Z,use_quota=True,user_id='9e4ead153c2d4a74bb19ca33a40d6492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8700c8f-d5c6-4c46-b5ce-f422bde91bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8700c8f-d5c6-4c46-b5ce-f422bde91bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb44101-2c8c-4fe3-9984-b3a42d3d50f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb44101-2c8c-4fe3-9984-b3a42d3d50f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd65a36e-5a54-4061-a708-c14d99ee7739', 'volume_name': 'volume-dd65a36e-5a54-4061-a708-c14d99ee7739', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778415d7-10a3-4521-9762-4a4b374562bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778415d7-10a3-4521-9762-4a4b374562bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7579a15b-dd45-438d-8e3a-53e3281faff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:08 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Volume dd65a36e-5a54-4061-a708-c14d99ee7739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd65a36e-5a54-4061-a708-c14d99ee7739', 'volume_size': 1} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64d2b49-b39b-463f-9690-7becbf02720a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.info" returned: 0 in 0.728s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:08 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.info is being set with open permissions: ugo+rw Apr 29 16:49:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:08 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.info Apr 29 16:49:08 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:08 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 Apr 29 16:49:08 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:09 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.info" returned: 0 in 0.632s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.404s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.764s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-841889132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0ab24c-5364-49d1-be73-412ccb1acc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:01Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Creating volume 0d0ab24c-5364-49d1-be73-412ccb1acc2e {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:09 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:09 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e 1073741824 Apr 29 16:49:09 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:09 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ab1fce1c-b29c-480c-8d00-935243d3d1bb tempest-VolumesSnapshotListTestJSON-1327953025 None] Create snapshot completed successfully Apr 29 16:49:09 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7" returned: 0 in 0.770s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:09 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7 Apr 29 16:49:09 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:10 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-93a30c72-6a85-4fe7-a033-432b1c8a45e7" returned: 0 in 0.595s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Lock "cinder-quobyte-93a30c72-6a85-4fe7-a033-432b1c8a45e7" released by "delete_volume" :: held 1.456s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['fb4cad3b-7de3-476d-b35e-23988c2cd1e1'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:10 devstack cinder-volume[84201]: WARNING cinder.quota [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-615745250 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-615745250, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Created reservations ['a7611e29-119d-41bc-b28b-bb245b0f26d2', '6838c384-8c95-4a49-a143-8f09baf829fc', '581d0b58-e10d-484e-b922-fc12eef5d46e', '51886610-7c20-4cb4-a9a7-83fda0376abb'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:10 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e 1073741824" returned: 0 in 0.840s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:10 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e Apr 29 16:49:10 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:10 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:10 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:11 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e" returned: 0 in 0.667s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.230s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1132934896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd65a36e-5a54-4061-a708-c14d99ee7739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74925f15d96469088969585d929ed49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:09Z,use_quota=True,user_id='9e4ead153c2d4a74bb19ca33a40d6492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Creating volume dd65a36e-5a54-4061-a708-c14d99ee7739 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:11 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:11 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e137ca-2b82-4081-b20e-cd00bebbcea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:11 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739 1073741824 Apr 29 16:49:11 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaad367-ca8e-47a0-a217-409237845f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.653s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e2b185f3-4b38-4c30-b01f-96350ac18654 tempest-GroupSnapshotsTest-830361566 None] Delete group completed successfully. Apr 29 16:49:11 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e (0d0ab24c-5364-49d1-be73-412ccb1acc2e): created successfully Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaad367-ca8e-47a0-a217-409237845f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (6fad5ed2-915d-4bbd-8dbe-15fa9281f15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0a0b4681-eb2d-4a79-98a0-81edd1fea347 tempest-CreateVolumesFromSnapshotTest-463857576 None] Created volume successfully. Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:11 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739 1073741824" returned: 0 in 0.904s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:12 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739 Apr 29 16:49:12 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:12 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739" returned: 0 in 0.649s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.014s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Creating offline snapshot 35ab67c1-666b-432f-aff1-6aa652d40d59 of volume f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7579a15b-dd45-438d-8e3a-53e3281faff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd65a36e-5a54-4061-a708-c14d99ee7739', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9ee4e3-db44-4236-b560-b877407f22eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5fd13a-7d04-4de5-a0a4-3d90867a9505]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:12 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Volume volume-dd65a36e-5a54-4061-a708-c14d99ee7739 (dd65a36e-5a54-4061-a708-c14d99ee7739): created successfully Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9ee4e3-db44-4236-b560-b877407f22eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Flow 'volume_create_manager' (df0fcb18-3b9f-461a-bffd-f5e10f445d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:12 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e8e87ac8-54a8-421e-b070-c0c363279594 tempest-VolumeQuotasAdminTestJSON-1844595900 None] Created volume successfully. Apr 29 16:49:12 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a Apr 29 16:49:12 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:13 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a" returned: 0 in 0.777s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03b2e43-c524-4f76-972e-2236dd7d316b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:13 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 1G Apr 29 16:49:13 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:13 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-35281fe3-7b10-4805-a271-69de7196faa6 tempest-VolumeQuotasAdminTestJSON-1232895559 None] Transfer volume completed successfully. Apr 29 16:49:14 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 1G" returned: 0 in 0.898s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:14 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 Apr 29 16:49:14 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Acquiring lock "cinder-dd65a36e-5a54-4061-a708-c14d99ee7739-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Lock "cinder-dd65a36e-5a54-4061-a708-c14d99ee7739-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Acquiring lock "cinder-quobyte-dd65a36e-5a54-4061-a708-c14d99ee7739" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Lock "cinder-quobyte-dd65a36e-5a54-4061-a708-c14d99ee7739" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1975632-f08c-4111-aa1f-10728e97da25]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:15 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739 Apr 29 16:49:15 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:15 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59" returned: 0 in 0.674s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:15 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 is being set with open permissions: ugo+rw Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:15 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 Apr 29 16:49:15 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:15 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739" returned: 0 in 0.782s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:15 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739 Apr 29 16:49:15 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:15 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59" returned: 0 in 0.640s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.130s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.275s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Creating offline snapshot c7412605-6fca-4d06-a402-62d52060be97 of volume 0d0ab24c-5364-49d1-be73-412ccb1acc2e {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:49:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ee078f86-30b4-4ffb-abea-846328f8a2ca tempest-VolumesSnapshotListTestJSON-1327953025 None] Create snapshot completed successfully Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddc36c6-1b4c-448a-bcea-dd118409dfe0]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:15 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e Apr 29 16:49:15 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:16 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd65a36e-5a54-4061-a708-c14d99ee7739" returned: 0 in 0.667s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Lock "cinder-quobyte-dd65a36e-5a54-4061-a708-c14d99ee7739" released by "delete_volume" :: held 1.500s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Created reservations ['da54c898-d11d-4dee-a2c5-35012a483ac6', '13b216d9-dd4f-421c-be6f-f4a9ef9602a9', '0a94828e-080d-48e7-8781-c82b67bcc3e0', '9f83d4e2-cbbf-4673-ae1a-e4c20aa64704'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:16 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:16 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:16 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e" returned: 0 in 0.744s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:16 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 1G Apr 29 16:49:16 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:17 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.706s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:17 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:17 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Deleted volume successfully. Apr 29 16:49:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-25ea636e-43ef-4ca5-b8c4-b6f1a286953e tempest-VolumeQuotasAdminTestJSON-401172142 None] Lock "cinder-dd65a36e-5a54-4061-a708-c14d99ee7739-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:17 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 1G" returned: 0 in 0.968s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:17 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 Apr 29 16:49:17 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:18 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97" returned: 0 in 0.736s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:18 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 is being set with open permissions: ugo+rw Apr 29 16:49:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:18 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 Apr 29 16:49:18 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:18 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97" returned: 0 in 0.656s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:19 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.info Apr 29 16:49:19 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:19 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.info" returned: 0 in 0.652s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:19 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.info is being set with open permissions: ugo+rw Apr 29 16:49:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:19 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.info Apr 29 16:49:19 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:20 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.info" returned: 0 in 0.692s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.581s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.117s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:20 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Creating offline snapshot 65131357-6318-486a-a1b8-c5d4de6def30 of volume f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:49:20 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c04fc72d-a11b-4d56-866a-c12c85ea6119 tempest-CreateVolumesFromSnapshotTest-463857576 None] Create snapshot completed successfully Apr 29 16:49:20 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f7f736-a5c1-430e-a819-b397a518645f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:20 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 Apr 29 16:49:20 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:21 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59" returned: 0 in 0.921s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03b2e43-c524-4f76-972e-2236dd7d316b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:21 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 1G Apr 29 16:49:21 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (ae84cac8-4005-42c5-9c31-c5ea485afdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81c7523-5f78-4e7d-81a6-a0da3c24bbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81c7523-5f78-4e7d-81a6-a0da3c24bbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143168616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ffce13-ec9f-4995-bdd2-a87d2a0a707b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:21Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1334f1c-4b09-4c60-ba4d-6ea9f9593b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1334f1c-4b09-4c60-ba4d-6ea9f9593b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288c7e81-a45b-47c3-bb39-724fc68b22bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288c7e81-a45b-47c3-bb39-724fc68b22bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ffce13-ec9f-4995-bdd2-a87d2a0a707b', 'volume_name': 'volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49d938b-93a4-4296-b246-c887a210620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49d938b-93a4-4296-b246-c887a210620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527ad4ec-9399-4c91-a2b8-641b298180c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:21 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume 65ffce13-ec9f-4995-bdd2-a87d2a0a707b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b', 'volume_size': 1} Apr 29 16:49:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (46a06af2-0ec6-436e-9f5c-34356fb15c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8ea545-60b7-4aa6-b5c5-0e02cede2c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8ea545-60b7-4aa6-b5c5-0e02cede2c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1047438675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7fe97e-0f6f-4fea-91a0-07df5d565a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:22Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc69564-00b9-4fc3-b0e4-f330ad287208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc69564-00b9-4fc3-b0e4-f330ad287208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03d06d0-16bd-48bf-a83c-ae47e851c667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03d06d0-16bd-48bf-a83c-ae47e851c667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7fe97e-0f6f-4fea-91a0-07df5d565a76', 'volume_name': 'volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11637d16-14ee-4576-aad7-ee1cfe7b32e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11637d16-14ee-4576-aad7-ee1cfe7b32e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca7aa58-e06b-4bb0-a822-3c2282645585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume 7b7fe97e-0f6f-4fea-91a0-07df5d565a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76', 'volume_size': 1} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (9f0aef70-db5d-45d9-9e54-217e9dc3febc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4287ba-f324-4889-a5f7-c2e2017a6962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4287ba-f324-4889-a5f7-c2e2017a6962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127540517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c351628-7703-4c30-9dd2-8def82c4b239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:22Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02ab858-2f7e-456e-b46f-9f22da37f253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02ab858-2f7e-456e-b46f-9f22da37f253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea29249-5838-4de1-a57c-bb85dc3b43f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea29249-5838-4de1-a57c-bb85dc3b43f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c351628-7703-4c30-9dd2-8def82c4b239', 'volume_name': 'volume-9c351628-7703-4c30-9dd2-8def82c4b239', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8227d6e-a26e-4686-8b4b-e2869325a975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8227d6e-a26e-4686-8b4b-e2869325a975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a7e008-a521-493b-b60d-ec400be99a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:22 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume 9c351628-7703-4c30-9dd2-8def82c4b239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c351628-7703-4c30-9dd2-8def82c4b239', 'volume_size': 1} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:22 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 1G" returned: 0 in 1.342s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:22 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 Apr 29 16:49:22 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (c28e5c85-0217-476d-88a7-fbf486a04ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7f66c4-4e08-4e9d-a733-65ccbe70cf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7f66c4-4e08-4e9d-a733-65ccbe70cf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257074838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1880f6-8e36-4e62-b631-473e4b116aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:23Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05f8bd1-3393-4dc5-9705-e2aa4b6e6447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05f8bd1-3393-4dc5-9705-e2aa4b6e6447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c1a305-6afe-4ff1-90dc-96d4971e68b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c1a305-6afe-4ff1-90dc-96d4971e68b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f1880f6-8e36-4e62-b631-473e4b116aad', 'volume_name': 'volume-1f1880f6-8e36-4e62-b631-473e4b116aad', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6573519-206b-4d6b-80bb-2d15234e79ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6573519-206b-4d6b-80bb-2d15234e79ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1ac848-5afd-484e-aedd-4d991ecf493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume 1f1880f6-8e36-4e62-b631-473e4b116aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f1880f6-8e36-4e62-b631-473e4b116aad', 'volume_size': 1} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (2d03d3b4-9115-40bb-a082-c149a3066a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34874ebc-c8f8-4c79-97e7-f4de6147520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34874ebc-c8f8-4c79-97e7-f4de6147520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1577619700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20734b56-7875-4d29-a7c8-c317b2dffb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:23Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2085ffbf-c11d-486e-b5a3-bdc51e64f7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2085ffbf-c11d-486e-b5a3-bdc51e64f7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cbc230-8bd3-40fc-90f6-45792c892590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cbc230-8bd3-40fc-90f6-45792c892590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20734b56-7875-4d29-a7c8-c317b2dffb96', 'volume_name': 'volume-20734b56-7875-4d29-a7c8-c317b2dffb96', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98f5f50-1a73-43bb-9e2d-ce4e111c544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98f5f50-1a73-43bb-9e2d-ce4e111c544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:23 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d91072-a8e9-4978-a2b2-0066f0f698a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:23 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume 20734b56-7875-4d29-a7c8-c317b2dffb96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20734b56-7875-4d29-a7c8-c317b2dffb96', 'volume_size': 1} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30" returned: 0 in 0.830s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:23 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 is being set with open permissions: ugo+rw Apr 29 16:49:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:23 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 Apr 29 16:49:23 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:24 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30" returned: 0 in 0.637s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.872s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.580s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143168616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ffce13-ec9f-4995-bdd2-a87d2a0a707b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:21Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Creating volume 65ffce13-ec9f-4995-bdd2-a87d2a0a707b {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:24 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:24 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b 1073741824 Apr 29 16:49:24 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:24 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6de73f23-5b19-4f5d-97ab-a43b48454af5 tempest-VolumesSnapshotListTestJSON-1327953025 None] Create snapshot completed successfully Apr 29 16:49:25 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b 1073741824" returned: 0 in 1.073s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:25 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b Apr 29 16:49:25 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-65131357-6318-486a-a1b8-c5d4de6def30-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-65131357-6318-486a-a1b8-c5d4de6def30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-quobyte-65131357-6318-486a-a1b8-c5d4de6def30" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-65131357-6318-486a-a1b8-c5d4de6def30" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Deleting offline snapshot 65131357-6318-486a-a1b8-c5d4de6def30 of volume f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] snapshot_file for this snap is: volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[547c6834-0789-4437-945b-b3449ed9c73a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:26 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b" returned: 0 in 0.755s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.022s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1047438675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7fe97e-0f6f-4fea-91a0-07df5d565a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:22Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Creating volume 7b7fe97e-0f6f-4fea-91a0-07df5d565a76 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:26 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=142,cinder:INSERT=35,cinder:UPDATE=168,cinder:DELETE=9 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:49:26 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 Apr 29 16:49:26 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:26 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 1073741824 Apr 29 16:49:26 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527ad4ec-9399-4c91-a2b8-641b298180c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cb06bf-6db7-42fb-ad80-fd2d8e106abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:INSERT=45,cinder:UPDATE=157,cinder:SELECT=134,cinder:DELETE=11 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:49:26 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b (65ffce13-ec9f-4995-bdd2-a87d2a0a707b): created successfully Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cb06bf-6db7-42fb-ad80-fd2d8e106abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (ae84cac8-4005-42c5-9c31-c5ea485afdc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:26 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-00d4d225-f2d6-424a-bdb6-31aeb50cb463 tempest-CreateVolumesFromSnapshotTest-463857576 None] Created volume successfully. Apr 29 16:49:27 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30" returned: 0 in 1.003s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03b2e43-c524-4f76-972e-2236dd7d316b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:27 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51387c2-c834-4237-8ab8-e37a7b31b4c0]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:27 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 1073741824" returned: 0 in 0.982s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:27 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 Apr 29 16:49:27 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:27 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 Apr 29 16:49:27 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:27 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59" returned: 0 in 0.896s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03b2e43-c524-4f76-972e-2236dd7d316b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:28 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76" returned: 0 in 0.781s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:28 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 Apr 29 16:49:28 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.306s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127540517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c351628-7703-4c30-9dd2-8def82c4b239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:22Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Creating volume 9c351628-7703-4c30-9dd2-8def82c4b239 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:28 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca7aa58-e06b-4bb0-a822-3c2282645585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a17712-e67f-4087-a635-3a532a6e03c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:28 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 (7b7fe97e-0f6f-4fea-91a0-07df5d565a76): created successfully Apr 29 16:49:28 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239 1073741824 Apr 29 16:49:28 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a17712-e67f-4087-a635-3a532a6e03c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (46a06af2-0ec6-436e-9f5c-34356fb15c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:28 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f19c6cff-f303-4618-8860-6c3e1a7e19ed tempest-CreateVolumesFromSnapshotTest-463857576 None] Created volume successfully. Apr 29 16:49:29 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30" returned: 0 in 1.055s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:29 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30 Apr 29 16:49:29 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:29 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239 1073741824" returned: 0 in 1.126s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:29 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239 Apr 29 16:49:29 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:29 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-bc6446ef-527c-4d94-bedf-62904c45fa54 tempest-GroupsV314Test-1857754758 None] Group tempest-GroupsV314Test-Group-1421170507: creating Apr 29 16:49:29 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-bc6446ef-527c-4d94-bedf-62904c45fa54 tempest-GroupsV314Test-1857754758 None] Group tempest-GroupsV314Test-Group-1421170507: created successfully Apr 29 16:49:29 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-bc6446ef-527c-4d94-bedf-62904c45fa54 tempest-GroupsV314Test-1857754758 None] Create group completed successfully. Apr 29 16:49:29 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.65131357-6318-486a-a1b8-c5d4de6def30" returned: 0 in 0.778s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-65131357-6318-486a-a1b8-c5d4de6def30" released by "_delete_snapshot" :: held 3.858s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" released by "delete_snapshot" :: held 3.891s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Created reservations ['f66df7cd-4ed9-452f-a161-76047895d23f', '54c103de-03f7-446d-bd2e-991dbc0c8f8d', 'fb9642a8-1fb3-44dd-82a8-e6e9775b1416', '05a61020-cc40-4c88-b54e-cf12cc0071f0'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:29 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239" returned: 0 in 0.752s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.724s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257074838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1880f6-8e36-4e62-b631-473e4b116aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:23Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Creating volume 1f1880f6-8e36-4e62-b631-473e4b116aad {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:29 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:30 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad 1073741824 Apr 29 16:49:30 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a7e008-a521-493b-b60d-ec400be99a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c351628-7703-4c30-9dd2-8def82c4b239', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160763e6-01e8-429e-a757-1f123b5d0fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:30 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume volume-9c351628-7703-4c30-9dd2-8def82c4b239 (9c351628-7703-4c30-9dd2-8def82c4b239): created successfully Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160763e6-01e8-429e-a757-1f123b5d0fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (9f0aef70-db5d-45d9-9e54-217e9dc3febc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b763d061-a376-402e-b16f-5d14b9c9bf5f tempest-CreateVolumesFromSnapshotTest-463857576 None] Created volume successfully. Apr 29 16:49:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Delete snapshot completed successfully. Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4a4a8a5-c428-49f8-9bdc-1c46d8f933ae tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-65131357-6318-486a-a1b8-c5d4de6def30-delete_snapshot" released by "delete_snapshot" :: held 4.198s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-35ab67c1-666b-432f-aff1-6aa652d40d59-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-35ab67c1-666b-432f-aff1-6aa652d40d59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-quobyte-35ab67c1-666b-432f-aff1-6aa652d40d59" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-35ab67c1-666b-432f-aff1-6aa652d40d59" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Deleting offline snapshot 35ab67c1-666b-432f-aff1-6aa652d40d59 of volume f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] snapshot_file for this snap is: volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da90e48-ba7c-4d0a-a0f6-a1e0b4fdee01]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:30 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 Apr 29 16:49:30 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:31 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad 1073741824" returned: 0 in 1.034s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:31 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad Apr 29 16:49:31 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Flow 'volume_create_manager' (27ed74d2-07c6-4a0f-a7ae-9cba80f6e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726f27f0-60a8-4321-8f66-3877fe55a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726f27f0-60a8-4321-8f66-3877fe55a44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-255405227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7be688f0-5a59-4130-9c21-167f78a3932b,host='devstack@QuobyteHD#QuobyteHD',id=d44facd3-863d-45f6-97ea-07c532eaf99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5f1c4b0da3400e98705ce7e412d5f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:31Z,use_quota=True,user_id='4ca5b2e9463646de8c391ffd173cbbb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d1f17a-b9df-4223-90e3-0e85c259a8a4),volume_type_id=49d1f17a-b9df-4223-90e3-0e85c259a8a4)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bbaf2e-fbea-48a6-86f3-eda9479fa453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:31 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bbaf2e-fbea-48a6-86f3-eda9479fa453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b89c79-a962-4fc5-a50a-f978c4a88a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b89c79-a962-4fc5-a50a-f978c4a88a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd44facd3-863d-45f6-97ea-07c532eaf99d', 'volume_name': 'volume-d44facd3-863d-45f6-97ea-07c532eaf99d', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086d6d1a-26af-4356-afdf-af9e8da32f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086d6d1a-26af-4356-afdf-af9e8da32f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4403867b-f891-4bac-acd6-edcc24e29073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:31 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Volume d44facd3-863d-45f6-97ea-07c532eaf99d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d44facd3-863d-45f6-97ea-07c532eaf99d', 'volume_size': 1} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59" returned: 0 in 0.952s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03b2e43-c524-4f76-972e-2236dd7d316b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e344fb-998a-4868-8e20-9ecb8a1c1e49]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:31 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a Apr 29 16:49:31 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:31 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad" returned: 0 in 0.728s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.244s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1577619700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20734b56-7875-4d29-a7c8-c317b2dffb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4484c944c446c69b9573af1ab62de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:23Z,use_quota=True,user_id='5f7ae96bcfa54d0d861e28ada3ef6b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Creating volume 20734b56-7875-4d29-a7c8-c317b2dffb96 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:31 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1ac848-5afd-484e-aedd-4d991ecf493e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f1880f6-8e36-4e62-b631-473e4b116aad', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:31 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96 1073741824 Apr 29 16:49:31 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a696265c-8d00-41b5-ad85-b77258ce538f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:31 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume volume-1f1880f6-8e36-4e62-b631-473e4b116aad (1f1880f6-8e36-4e62-b631-473e4b116aad): created successfully Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a696265c-8d00-41b5-ad85-b77258ce538f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (c28e5c85-0217-476d-88a7-fbf486a04ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:31 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d917ccee-cfc6-470d-8aa5-cf26db031d7c tempest-CreateVolumesFromSnapshotTest-463857576 None] Created volume successfully. Apr 29 16:49:32 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a" returned: 0 in 0.743s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03b2e43-c524-4f76-972e-2236dd7d316b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:32 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 Apr 29 16:49:32 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Flow 'volume_create_manager' (ea3ddc20-6160-4f81-9b06-eda5f928ab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a5a264-498b-466d-83e9-521acf2ed59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a5a264-498b-466d-83e9-521acf2ed59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1271305604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0a6136-b4c1-4076-86f1-2eb3f76201df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58825e62fe824366bbb83222fc6b4926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:33Z,use_quota=True,user_id='6e28d4aef8a2444aab4b4770fcb5b62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:32 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0047f2f8-f093-4273-abf6-894cc7933af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0047f2f8-f093-4273-abf6-894cc7933af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df52d8f2-0d07-42a3-aa96-df105b363dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df52d8f2-0d07-42a3-aa96-df105b363dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0a6136-b4c1-4076-86f1-2eb3f76201df', 'volume_name': 'volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84072700-7f12-4f52-a37f-bbde2fbd05b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84072700-7f12-4f52-a37f-bbde2fbd05b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24d6689-48d4-41f5-8927-85e0e40b32bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:32 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Volume 5b0a6136-b4c1-4076-86f1-2eb3f76201df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df', 'volume_size': 1} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96 1073741824" returned: 0 in 0.996s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:32 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96 Apr 29 16:49:32 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:32 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59" returned: 0 in 0.873s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:33 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59 Apr 29 16:49:33 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:33 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96" returned: 0 in 0.601s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.153s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7be688f0-5a59-4130-9c21-167f78a3932b,created_at=2026-04-29T14:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-255405227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7be688f0-5a59-4130-9c21-167f78a3932b,host='devstack@QuobyteHD#QuobyteHD',id=d44facd3-863d-45f6-97ea-07c532eaf99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5f1c4b0da3400e98705ce7e412d5f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:31Z,use_quota=True,user_id='4ca5b2e9463646de8c391ffd173cbbb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d1f17a-b9df-4223-90e3-0e85c259a8a4),volume_type_id=49d1f17a-b9df-4223-90e3-0e85c259a8a4)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Creating volume d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:33 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d91072-a8e9-4978-a2b2-0066f0f698a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20734b56-7875-4d29-a7c8-c317b2dffb96', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:33 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d 1073741824 Apr 29 16:49:33 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7f2160-6203-4b82-82e1-d96064720a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:33 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Volume volume-20734b56-7875-4d29-a7c8-c317b2dffb96 (20734b56-7875-4d29-a7c8-c317b2dffb96): created successfully Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7f2160-6203-4b82-82e1-d96064720a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Flow 'volume_create_manager' (2d03d3b4-9115-40bb-a082-c149a3066a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8a7ea4d4-960e-472a-988d-03e297c9fbc1 tempest-CreateVolumesFromSnapshotTest-463857576 None] Created volume successfully. Apr 29 16:49:33 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.35ab67c1-666b-432f-aff1-6aa652d40d59" returned: 0 in 0.636s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-35ab67c1-666b-432f-aff1-6aa652d40d59" released by "_delete_snapshot" :: held 3.316s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" released by "delete_snapshot" :: held 3.339s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Created reservations ['4f4d5c58-8970-4e2f-a7a0-f2f68251fed1', 'c31e435e-fcbf-4a87-ba03-07df37f271e8', '66eb7aa2-2c15-44a0-ad23-16eddc833c08', '5bd172ca-d6fb-4619-b6cf-2608bbe06266'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Delete snapshot completed successfully. Apr 29 16:49:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e54cdf8-287a-420b-bc1b-11753ac83c2d tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-35ab67c1-666b-432f-aff1-6aa652d40d59-delete_snapshot" released by "delete_snapshot" :: held 3.480s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:34 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d 1073741824" returned: 0 in 0.779s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:34 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d Apr 29 16:49:34 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-3503e405-9ced-4f53-b4b5-80af94af6c9a-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-3503e405-9ced-4f53-b4b5-80af94af6c9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-quobyte-3503e405-9ced-4f53-b4b5-80af94af6c9a" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-3503e405-9ced-4f53-b4b5-80af94af6c9a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Deleting offline snapshot 3503e405-9ced-4f53-b4b5-80af94af6c9a of volume f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] snapshot_file for this snap is: volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5596b80-c916-42d1-9a80-5d92167728e3]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-20734b56-7875-4d29-a7c8-c317b2dffb96-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-20734b56-7875-4d29-a7c8-c317b2dffb96-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:34 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a Apr 29 16:49:34 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-quobyte-20734b56-7875-4d29-a7c8-c317b2dffb96" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-20734b56-7875-4d29-a7c8-c317b2dffb96" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3bd4ec-607c-4a2a-9694-5a004689f8d8]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:34 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d" returned: 0 in 0.669s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:34 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96 Apr 29 16:49:34 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.133s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1271305604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0a6136-b4c1-4076-86f1-2eb3f76201df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58825e62fe824366bbb83222fc6b4926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:33Z,use_quota=True,user_id='6e28d4aef8a2444aab4b4770fcb5b62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Creating volume 5b0a6136-b4c1-4076-86f1-2eb3f76201df {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:34 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4403867b-f891-4bac-acd6-edcc24e29073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44facd3-863d-45f6-97ea-07c532eaf99d', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:35 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df 1073741824 Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd89bb1b-40e2-4a85-8e1a-1ea39e9413ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:35 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:35 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Volume volume-d44facd3-863d-45f6-97ea-07c532eaf99d (d44facd3-863d-45f6-97ea-07c532eaf99d): created successfully Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd89bb1b-40e2-4a85-8e1a-1ea39e9413ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Flow 'volume_create_manager' (27ed74d2-07c6-4a0f-a7ae-9cba80f6e86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-28c32f28-7203-4e05-9a9e-c1133f16a050 tempest-GroupsV314Test-1857754758 None] Created volume successfully. Apr 29 16:49:35 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a" returned: 0 in 0.757s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03b2e43-c524-4f76-972e-2236dd7d316b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d30f08-f81f-4dec-960a-93627a5078c1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:35 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b Apr 29 16:49:35 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:35 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96" returned: 0 in 0.799s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:35 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96 Apr 29 16:49:35 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:35 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df 1073741824" returned: 0 in 0.910s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:35 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df Apr 29 16:49:35 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:36 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b" returned: 0 in 0.740s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:36 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a Apr 29 16:49:36 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:36 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-20734b56-7875-4d29-a7c8-c317b2dffb96" returned: 0 in 0.658s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-20734b56-7875-4d29-a7c8-c317b2dffb96" released by "delete_volume" :: held 1.515s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Created reservations ['ee2a3f80-7af8-445d-a49b-d9138c69af9d', '6762c4b9-1feb-4d53-8227-8be3ef5c13c2', '69c6ad5c-b1dc-49f7-afd0-de255eb07676', 'ba165f3e-7c7b-4dc4-bf40-e220035ba113'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:36 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:36 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:36 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df" returned: 0 in 0.645s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24d6689-48d4-41f5-8927-85e0e40b32bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa7fc93-2017-48a3-a50a-00c052345a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:36 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Volume volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df (5b0a6136-b4c1-4076-86f1-2eb3f76201df): created successfully Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa7fc93-2017-48a3-a50a-00c052345a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Flow 'volume_create_manager' (ea3ddc20-6160-4f81-9b06-eda5f928ab45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:36 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-3c8b26e0-adf1-498e-ad15-6423f2a8565f tempest-VolumesListAdminTestJSON-470874475 None] Created volume successfully. Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:36 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Cloning volume d44facd3-863d-45f6-97ea-07c532eaf99d to volume 678193eb-77fa-4a81-8264-25782bdfe6ca Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Creating offline snapshot 34f0ed47-d99d-402e-b4b6-4fc33261ed44 of volume d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e693bbf2-9eb2-4151-b9aa-f0e63570920e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:36 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d Apr 29 16:49:36 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-1f1880f6-8e36-4e62-b631-473e4b116aad-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-1f1880f6-8e36-4e62-b631-473e4b116aad-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:37 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a" returned: 0 in 0.948s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-quobyte-1f1880f6-8e36-4e62-b631-473e4b116aad" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:37 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a Apr 29 16:49:37 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-1f1880f6-8e36-4e62-b631-473e4b116aad" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c258b2-5780-4e72-ba6c-2fd3e26747ce]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:37 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.786s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:37 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Deleted volume successfully. Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4c9cc7-bf7b-4574-9349-ae67c9ddb53d tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-20734b56-7875-4d29-a7c8-c317b2dffb96-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:37 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad Apr 29 16:49:37 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Flow 'volume_create_manager' (f9561b20-ff38-4917-8a0b-8cc8b83f7d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dd0eba-40fd-4fcc-87bd-e7a783ba68a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dd0eba-40fd-4fcc-87bd-e7a783ba68a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-346330978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1ab6c8-304e-4f13-ab11-e0867c440a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58825e62fe824366bbb83222fc6b4926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:38Z,use_quota=True,user_id='6e28d4aef8a2444aab4b4770fcb5b62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1609fbb0-03be-4e3f-a4dc-fd6ec1229d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1609fbb0-03be-4e3f-a4dc-fd6ec1229d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39267eb5-e2f6-4ab2-b07e-e4ffb641134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39267eb5-e2f6-4ab2-b07e-e4ffb641134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1ab6c8-304e-4f13-ab11-e0867c440a40', 'volume_name': 'volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8bb6796-5da7-421e-b143-8a09dacec8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8bb6796-5da7-421e-b143-8a09dacec8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d59a1f5-2da3-4279-8046-4489a748665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:37 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Volume 2a1ab6c8-304e-4f13-ab11-e0867c440a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40', 'volume_size': 1} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:37 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d" returned: 0 in 0.964s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:37 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 1G Apr 29 16:49:37 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:37 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b.3503e405-9ced-4f53-b4b5-80af94af6c9a" returned: 0 in 0.791s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-3503e405-9ced-4f53-b4b5-80af94af6c9a" released by "_delete_snapshot" :: held 3.359s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" released by "delete_snapshot" :: held 3.386s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Created reservations ['d666d4bf-89ca-4788-8e5d-110ef26c3b15', 'bcc44ed7-35cc-45b5-b604-7d9b327e3faa', '4e00909b-dd20-41cb-9b39-a5afd7b95ef8', 'd5155f95-1b68-4f0f-8fd7-17e7fb530911'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:38 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad" returned: 0 in 0.921s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:38 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad Apr 29 16:49:38 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:38 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Delete snapshot completed successfully. Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-636b44ef-d2b5-46e7-b993-2f2df26922fd tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-3503e405-9ced-4f53-b4b5-80af94af6c9a-delete_snapshot" released by "delete_snapshot" :: held 3.634s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:38 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 1G" returned: 0 in 0.783s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44facd3-863d-45f6-97ea-07c532eaf99d -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:38 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44facd3-863d-45f6-97ea-07c532eaf99d -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 Apr 29 16:49:38 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:38 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f1880f6-8e36-4e62-b631-473e4b116aad" returned: 0 in 0.634s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-1f1880f6-8e36-4e62-b631-473e4b116aad" released by "delete_volume" :: held 1.618s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Created reservations ['0377aba4-37ca-4b4d-89c5-d291c9d4c802', '6951d24b-3e52-4b70-a0a6-ff14636132e6', '209d6b36-d866-4763-9a3a-fa7c636a13a7', '4c73a9ac-374c-462d-ba58-ad59c6757da2'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-f03b2e43-c524-4f76-972e-2236dd7d316b-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-f03b2e43-c524-4f76-972e-2236dd7d316b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:38 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:38 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b26f7d-56be-4cc8-9b94-9581b6891eaa]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:39 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b Apr 29 16:49:39 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-9c351628-7703-4c30-9dd2-8def82c4b239-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-9c351628-7703-4c30-9dd2-8def82c4b239-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:39 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44facd3-863d-45f6-97ea-07c532eaf99d -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44" returned: 0 in 0.747s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:39 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:39 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 Apr 29 16:49:39 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-quobyte-9c351628-7703-4c30-9dd2-8def82c4b239" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-9c351628-7703-4c30-9dd2-8def82c4b239" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bc4790-55fc-4767-8fbd-f3939c2e173a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:39 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239 Apr 29 16:49:39 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:39 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.658s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:39 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Deleted volume successfully. Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-543337e1-e507-46aa-be56-caf05fed5293 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-1f1880f6-8e36-4e62-b631-473e4b116aad-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:39 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b" returned: 0 in 0.845s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:39 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b Apr 29 16:49:39 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:40 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44" returned: 0 in 0.684s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:40 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.info Apr 29 16:49:40 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:40 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239" returned: 0 in 0.769s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:40 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239 Apr 29 16:49:40 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:40 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f03b2e43-c524-4f76-972e-2236dd7d316b" returned: 0 in 0.620s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-quobyte-f03b2e43-c524-4f76-972e-2236dd7d316b" released by "delete_volume" :: held 1.534s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Created reservations ['d542edd3-0aa7-411f-8d9d-1abc16f0ffb3', '13d241f4-1f5a-40ff-a575-788d7331f7e8', 'c1b373a7-1fc0-482a-b874-2be137256de3', '8d33f8c9-9240-4fc6-936c-bbac0463ab80'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:40 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:40 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:40 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.info" returned: 0 in 0.663s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:40 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:40 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.info Apr 29 16:49:40 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:40 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-9c351628-7703-4c30-9dd2-8def82c4b239" returned: 0 in 0.642s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-9c351628-7703-4c30-9dd2-8def82c4b239" released by "delete_volume" :: held 1.456s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Created reservations ['5e1b698c-f709-4e3f-8818-dd42720c2294', '3c106d03-e274-41b5-a246-ff340937ea77', '5e4bd765-8b96-4e31-af28-ed39e7b1802e', '5bf8a8f1-d2ad-4cf6-a953-f8bedfa2a9c3'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:41 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:41 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:41 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.629s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:41 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Deleted volume successfully. Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0dd00591-410c-4822-9292-c05477c96e2e tempest-VolumesSnapshotListTestJSON-1327953025 None] Lock "cinder-f03b2e43-c524-4f76-972e-2236dd7d316b-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:41 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.info" returned: 0 in 0.627s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Acquiring lock "cinder-quobyte-678193eb-77fa-4a81-8264-25782bdfe6ca" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Lock "cinder-quobyte-678193eb-77fa-4a81-8264-25782bdfe6ca" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] snapshot: 34f0ed47-d99d-402e-b4b6-4fc33261ed44, volume: 678193eb-77fa-4a81-8264-25782bdfe6ca, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[727a85b6-ecc1-4b64-ac9e-c6f37fe0297c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-7b7fe97e-0f6f-4fea-91a0-07df5d565a76-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:41 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 Apr 29 16:49:41 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-7b7fe97e-0f6f-4fea-91a0-07df5d565a76-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-quobyte-7b7fe97e-0f6f-4fea-91a0-07df5d565a76" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-7b7fe97e-0f6f-4fea-91a0-07df5d565a76" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[669871d5-0166-4fb1-898f-a0edb473d63c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:41 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.759s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:41 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Deleted volume successfully. Apr 29 16:49:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-77a60f09-4526-412d-b190-d63d4e020c27 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-9c351628-7703-4c30-9dd2-8def82c4b239-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:41 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 Apr 29 16:49:41 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:42 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44" returned: 0 in 0.836s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d44facd3-863d-45f6-97ea-07c532eaf99d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:49:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:49:42 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c298252f-05d7-43ad-b869-c024ae913477]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:42 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d Apr 29 16:49:42 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:42 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76" returned: 0 in 0.871s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:42 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76 Apr 29 16:49:42 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:43 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d" returned: 0 in 0.818s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:43 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca Apr 29 16:49:43 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:43 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7b7fe97e-0f6f-4fea-91a0-07df5d565a76" returned: 0 in 0.641s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-7b7fe97e-0f6f-4fea-91a0-07df5d565a76" released by "delete_volume" :: held 1.565s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Created reservations ['872b2d61-8905-456d-aa48-f1ca4ed2f258', '9d64ddbf-f975-4ad4-b187-15f3c6408f54', 'b4ed151b-85d1-448d-96c6-e1614c52fd65', 'f53db1fa-c546-4732-bb8b-4845571f2838'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:43 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:43 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-65ffce13-ec9f-4995-bdd2-a87d2a0a707b-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-65ffce13-ec9f-4995-bdd2-a87d2a0a707b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-quobyte-65ffce13-ec9f-4995-bdd2-a87d2a0a707b" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-65ffce13-ec9f-4995-bdd2-a87d2a0a707b" acquired by "delete_volume" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:44 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cfb3c0-5c7b-4238-ae81-3528006e0232]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:44 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.692s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:44 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:44 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Deleted volume successfully. Apr 29 16:49:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71b67345-a424-4ddf-9bbf-61e35ea2899e tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-7b7fe97e-0f6f-4fea-91a0-07df5d565a76-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:44 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b Apr 29 16:49:44 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (aafc2720-9e45-4600-9d03-dc73fcb99d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7977006e-a147-45d8-801f-180b2a17a37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7977006e-a147-45d8-801f-180b2a17a37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523175362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf65338-8b96-4b75-a439-2f972bdeec01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:45Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e03252b-553c-4502-80d0-0b0dba768311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e03252b-553c-4502-80d0-0b0dba768311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2201d5db-4a63-4445-8089-434323eff3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2201d5db-4a63-4445-8089-434323eff3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf65338-8b96-4b75-a439-2f972bdeec01', 'volume_name': 'volume-1cf65338-8b96-4b75-a439-2f972bdeec01', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a392a3b6-86bb-441f-8db7-26d5264f140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a392a3b6-86bb-441f-8db7-26d5264f140b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab75f27-f040-449c-ad4c-8e6711b939fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:45 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Volume 1cf65338-8b96-4b75-a439-2f972bdeec01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf65338-8b96-4b75-a439-2f972bdeec01', 'volume_size': 1} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:45 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b" returned: 0 in 1.923s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:46 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b Apr 29 16:49:46 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (28b8561c-812f-4968-a92a-578d1a3cd492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776e86de-1066-4610-a6af-669a4bc17bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776e86de-1066-4610-a6af-669a4bc17bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2048014176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ef6713-70f4-4591-a102-6a0f2521a37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:46Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaf228c-84c2-40f4-8a36-a05c48ca6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaf228c-84c2-40f4-8a36-a05c48ca6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b75cced-0e95-45d7-8279-991cce6ece95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b75cced-0e95-45d7-8279-991cce6ece95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ef6713-70f4-4591-a102-6a0f2521a37d', 'volume_name': 'volume-21ef6713-70f4-4591-a102-6a0f2521a37d', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008e948d-d06f-472c-8eec-2c59a2024344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008e948d-d06f-472c-8eec-2c59a2024344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d820ee-f989-474c-ad3f-be7c3cb421f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:46 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Volume 21ef6713-70f4-4591-a102-6a0f2521a37d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ef6713-70f4-4591-a102-6a0f2521a37d', 'volume_size': 1} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (5c38f950-a741-4fcb-8b3d-fe7d91392051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786bc00d-afa9-4754-94fc-12e53521d5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786bc00d-afa9-4754-94fc-12e53521d5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1643927542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372a3518-3c25-42d7-962d-3fc368211499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:47Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0134b8-954f-411a-9201-f40d813582f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0134b8-954f-411a-9201-f40d813582f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af159268-d019-49af-a83c-5b77e39671df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af159268-d019-49af-a83c-5b77e39671df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372a3518-3c25-42d7-962d-3fc368211499', 'volume_name': 'volume-372a3518-3c25-42d7-962d-3fc368211499', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70690582-370a-49b7-8753-b10957e0fb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70690582-370a-49b7-8753-b10957e0fb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b579980d-04d1-4037-bbc7-d9e690f370fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:47 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Volume 372a3518-3c25-42d7-962d-3fc368211499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372a3518-3c25-42d7-962d-3fc368211499', 'volume_size': 1} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:47 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-65ffce13-ec9f-4995-bdd2-a87d2a0a707b" returned: 0 in 1.396s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-65ffce13-ec9f-4995-bdd2-a87d2a0a707b" released by "delete_volume" :: held 3.390s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Created reservations ['34e72c79-12c7-4991-90a2-59bf40af854b', '409afeed-90e1-49b1-8257-a964c006092e', 'bc2dc4f5-a1d2-4dc4-8d1b-f269558a8acc', '32cbd451-89f3-4043-bafc-e4a7d0ae8064'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:47 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:47 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (a8701756-08ea-4ca0-9696-03f62b8116fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08527e97-b3f9-4296-82ba-c4995a693fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08527e97-b3f9-4296-82ba-c4995a693fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105419331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9126e9-5371-4020-b834-d4924c9ec470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:48Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d03d4f-b53d-4dcb-846e-56bfc992020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d03d4f-b53d-4dcb-846e-56bfc992020a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcead22f-5534-4c6f-808d-4b12a54c28cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcead22f-5534-4c6f-808d-4b12a54c28cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad9126e9-5371-4020-b834-d4924c9ec470', 'volume_name': 'volume-ad9126e9-5371-4020-b834-d4924c9ec470', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d35e90-f153-4152-a568-fddc753aae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d35e90-f153-4152-a568-fddc753aae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6728852-0937-4d19-b40a-f7b454f9d0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:48 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Volume ad9126e9-5371-4020-b834-d4924c9ec470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad9126e9-5371-4020-b834-d4924c9ec470', 'volume_size': 1} Apr 29 16:49:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:49 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-c7412605-6fca-4d06-a402-62d52060be97-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.456s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:49 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Deleted volume successfully. Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-c7412605-6fca-4d06-a402-62d52060be97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-quobyte-0d0ab24c-5364-49d1-be73-412ccb1acc2e" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-0d0ab24c-5364-49d1-be73-412ccb1acc2e" acquired by "delete_snapshot" :: waited 0.076s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-quobyte-c7412605-6fca-4d06-a402-62d52060be97" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-99d436ed-fa15-4471-b3e8-ff9409c2cd97 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-65ffce13-ec9f-4995-bdd2-a87d2a0a707b-delete_volume" released by "delete_volume" :: held 5.312s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-c7412605-6fca-4d06-a402-62d52060be97" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Deleting offline snapshot c7412605-6fca-4d06-a402-62d52060be97 of volume 0d0ab24c-5364-49d1-be73-412ccb1acc2e {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] snapshot_file for this snap is: volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0773e85-de66-44e0-b201-da93541ab267]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (a6a215ca-ceb6-4330-8d64-b35ab58c768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6510971c-b046-46d9-9e67-c5bb4ab9a7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:49 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6510971c-b046-46d9-9e67-c5bb4ab9a7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104047919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accaeca6-4ee7-40db-827e-3716c80661a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:49Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e6e45a-f4be-46d2-a1e3-2a8a11b783ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e6e45a-f4be-46d2-a1e3-2a8a11b783ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f05ef8-b394-4ed7-8c53-ed9df7004a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f05ef8-b394-4ed7-8c53-ed9df7004a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'accaeca6-4ee7-40db-827e-3716c80661a5', 'volume_name': 'volume-accaeca6-4ee7-40db-827e-3716c80661a5', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05c5749-25d7-45e2-a343-b1997224e519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05c5749-25d7-45e2-a343-b1997224e519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dc1874-efb0-41a0-90cc-8635628f2116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:49 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Volume accaeca6-4ee7-40db-827e-3716c80661a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-accaeca6-4ee7-40db-827e-3716c80661a5', 'volume_size': 1} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:49 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca" returned: 0 in 6.274s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:49 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d3465f-ad2f-4abf-ba4b-34e11b19d17c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:49 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d Apr 29 16:49:49 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:50 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97" returned: 0 in 0.739s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[115ffc2f-f6ee-4d53-a7a8-6b4023f6d7b1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:50 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e Apr 29 16:49:50 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:50 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d" returned: 0 in 0.869s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:49:50 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Converted 1024.00 MB image at 163.20 MB/s Apr 29 16:49:50 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:50 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca Apr 29 16:49:50 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:50 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e" returned: 0 in 0.729s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:50 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 Apr 29 16:49:50 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:50 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca" returned: 0 in 0.597s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Lock "cinder-quobyte-678193eb-77fa-4a81-8264-25782bdfe6ca" released by "_copy_volume_from_snapshot" :: held 9.495s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Acquiring lock "cinder-quobyte-34f0ed47-d99d-402e-b4b6-4fc33261ed44" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Lock "cinder-quobyte-34f0ed47-d99d-402e-b4b6-4fc33261ed44" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Deleting offline snapshot 34f0ed47-d99d-402e-b4b6-4fc33261ed44 of volume d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] snapshot_file for this snap is: volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[63965192-56ec-4e4f-9f8e-4b914e473805]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:51 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 Apr 29 16:49:51 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:51 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97" returned: 0 in 0.720s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:51 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97 Apr 29 16:49:51 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:51 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44" returned: 0 in 0.724s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d44facd3-863d-45f6-97ea-07c532eaf99d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:49:51 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[12abdfb6-5166-437f-8e6b-7c2b8fd13d55]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:51 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d Apr 29 16:49:51 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:52 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e.c7412605-6fca-4d06-a402-62d52060be97" returned: 0 in 0.593s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-c7412605-6fca-4d06-a402-62d52060be97" released by "_delete_snapshot" :: held 2.909s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-0d0ab24c-5364-49d1-be73-412ccb1acc2e" released by "delete_snapshot" :: held 2.969s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:52 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Created reservations ['40cc6e51-07f5-4ed1-9b84-c797edab8581', '6bc845d7-b2ca-4ca5-a7e3-b09f8bd4fb6b', '261d40e7-e2bf-4fa2-9f01-3e6410fc1398', 'fac866ba-46c7-44f9-a26e-9fb996cb8886'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Delete snapshot completed successfully. Apr 29 16:49:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-4515251d-0e4e-4eaa-abe5-d6ea9b9b94db tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-c7412605-6fca-4d06-a402-62d52060be97-delete_snapshot" released by "delete_snapshot" :: held 3.156s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:52 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d" returned: 0 in 0.682s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:52 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 Apr 29 16:49:52 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:53 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44" returned: 0 in 0.664s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:53 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44 Apr 29 16:49:53 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-0d0ab24c-5364-49d1-be73-412ccb1acc2e-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-0d0ab24c-5364-49d1-be73-412ccb1acc2e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "cinder-quobyte-0d0ab24c-5364-49d1-be73-412ccb1acc2e" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-0d0ab24c-5364-49d1-be73-412ccb1acc2e" acquired by "delete_volume" :: waited 0.028s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7739ce-d641-45ed-9e2d-87f9aac6a647]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:53 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e Apr 29 16:49:53 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:53 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d.34f0ed47-d99d-402e-b4b6-4fc33261ed44" returned: 0 in 0.644s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Lock "cinder-quobyte-34f0ed47-d99d-402e-b4b6-4fc33261ed44" released by "_delete_snapshot" :: held 2.802s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.979s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.960s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-346330978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1ab6c8-304e-4f13-ab11-e0867c440a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58825e62fe824366bbb83222fc6b4926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:38Z,use_quota=True,user_id='6e28d4aef8a2444aab4b4770fcb5b62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Creating volume 2a1ab6c8-304e-4f13-ab11-e0867c440a40 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:53 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:53 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 1073741824 Apr 29 16:49:53 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:53 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6fa97aa0-ba6d-46ad-84dc-d3058a73d6e6 tempest-GroupsV314Test-1857754758 None] Create group from source-group-7be688f0-5a59-4130-9c21-167f78a3932b completed successfully. Apr 29 16:49:54 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e" returned: 0 in 0.732s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:54 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e Apr 29 16:49:54 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Acquiring lock "cinder-quobyte-678193eb-77fa-4a81-8264-25782bdfe6ca" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Lock "cinder-quobyte-678193eb-77fa-4a81-8264-25782bdfe6ca" acquired by "delete_volume" :: waited 0.033s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[01503877-8386-4a42-aa96-8d363581df0e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:54 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 1073741824" returned: 0 in 0.880s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:54 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca Apr 29 16:49:54 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:54 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 Apr 29 16:49:54 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:54 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0d0ab24c-5364-49d1-be73-412ccb1acc2e" returned: 0 in 0.659s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-quobyte-0d0ab24c-5364-49d1-be73-412ccb1acc2e" released by "delete_volume" :: held 1.463s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Created reservations ['00081d69-9ea0-4dbc-924c-00e91ccb4dbe', '2a606eb4-d526-44ba-a45d-2f4a80357100', 'b5331280-5171-4f6a-9c72-1f46f9844e5c', '07766dd4-4795-41dc-a7a5-d594cd179319'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:54 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:54 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:55 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca" returned: 0 in 0.741s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:55 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca Apr 29 16:49:55 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:55 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40" returned: 0 in 0.671s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.990s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523175362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf65338-8b96-4b75-a439-2f972bdeec01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:45Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Creating volume 1cf65338-8b96-4b75-a439-2f972bdeec01 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:55 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d59a1f5-2da3-4279-8046-4489a748665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:55 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01 1073741824 Apr 29 16:49:55 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e8283e-5741-4e0f-8ad1-f5fdb2a4e21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:55 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Volume volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 (2a1ab6c8-304e-4f13-ab11-e0867c440a40): created successfully Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e8283e-5741-4e0f-8ad1-f5fdb2a4e21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Flow 'volume_create_manager' (f9561b20-ff38-4917-8a0b-8cc8b83f7d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:55 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8c8ad170-2503-42f3-a452-89ecee0d4486 tempest-VolumesListAdminTestJSON-470874475 None] Created volume successfully. Apr 29 16:49:55 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.651s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:55 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Deleted volume successfully. Apr 29 16:49:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f031c619-962f-4643-a89a-ded3e47bf3c0 tempest-CreateVolumesFromSnapshotTest-463857576 None] Lock "cinder-0d0ab24c-5364-49d1-be73-412ccb1acc2e-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:56 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-678193eb-77fa-4a81-8264-25782bdfe6ca" returned: 0 in 0.754s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Lock "cinder-quobyte-678193eb-77fa-4a81-8264-25782bdfe6ca" released by "delete_volume" :: held 1.554s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Created reservations ['0a4a52ed-cf19-4d1d-84d4-83f3d4e1ec68'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:56 devstack cinder-volume[84201]: WARNING cinder.quota [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-388277514 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-388277514, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:49:56 devstack cinder-volume[84201]: WARNING cinder.quota [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-388277514 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-388277514, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Created reservations ['1249f853-3d6c-4cc9-a939-1f36b1e0df65', 'c01323e5-555f-406d-8e90-72f6d02cae76', 'eac1b215-785a-48e3-a45f-22670b04b4ca', 'f24b4a4a-d581-451b-926e-b624b94af7cf'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:56 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01 1073741824" returned: 0 in 0.960s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:56 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:56 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:56 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01 Apr 29 16:49:56 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Flow 'volume_create_manager' (48bebb11-7bff-48de-abc9-6e5165290c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e440d891-fa46-4d74-bb8c-e7c18927b138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e440d891-fa46-4d74-bb8c-e7c18927b138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-346282841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58825e62fe824366bbb83222fc6b4926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:57Z,use_quota=True,user_id='6e28d4aef8a2444aab4b4770fcb5b62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00964d5b-9347-403d-bf39-5dbec81b30d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00964d5b-9347-403d-bf39-5dbec81b30d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d04c7f-224a-4686-a71c-d9336a977ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d04c7f-224a-4686-a71c-d9336a977ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6', 'volume_name': 'volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e370caf3-c9dc-410b-9a80-8a22a0a445c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e370caf3-c9dc-410b-9a80-8a22a0a445c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a1800f-31f2-4e73-bc44-b8a35feab22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:57 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Volume 4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6', 'volume_size': 1} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Acquiring lock "cinder-quobyte-d44facd3-863d-45f6-97ea-07c532eaf99d" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Lock "cinder-quobyte-d44facd3-863d-45f6-97ea-07c532eaf99d" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b2f787-9440-447e-8f5c-07066cf4df8c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:57 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.919s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-099c6765-e1a2-4ec7-9579-71be7cbd9e20 tempest-GroupsV314Test-1857754758 None] Delete group completed successfully. Apr 29 16:49:57 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01" returned: 0 in 0.937s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.198s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2048014176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ef6713-70f4-4591-a102-6a0f2521a37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:46Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Creating volume 21ef6713-70f4-4591-a102-6a0f2521a37d {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:57 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:57 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d Apr 29 16:49:57 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:57 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d 1073741824 Apr 29 16:49:57 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab75f27-f040-449c-ad4c-8e6711b939fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf65338-8b96-4b75-a439-2f972bdeec01', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9376c4-3ebc-42c1-bd3d-f9b41734737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:57 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Volume volume-1cf65338-8b96-4b75-a439-2f972bdeec01 (1cf65338-8b96-4b75-a439-2f972bdeec01): created successfully Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9376c4-3ebc-42c1-bd3d-f9b41734737f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:57 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (aafc2720-9e45-4600-9d03-dc73fcb99d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-89e09562-d371-436a-b749-5952df8d1387 tempest-CreateVolumesFromImageTest-659762052 None] Created volume successfully. Apr 29 16:49:58 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d" returned: 0 in 0.812s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:58 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d Apr 29 16:49:58 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:58 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d 1073741824" returned: 0 in 0.865s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:58 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d Apr 29 16:49:58 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:58 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d44facd3-863d-45f6-97ea-07c532eaf99d" returned: 0 in 0.668s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Lock "cinder-quobyte-d44facd3-863d-45f6-97ea-07c532eaf99d" released by "delete_volume" :: held 1.556s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Created reservations ['6abe8098-902e-4c6c-8fea-4497df540e01'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:58 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d" returned: 0 in 0.647s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.821s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1643927542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372a3518-3c25-42d7-962d-3fc368211499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:47Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Creating volume 372a3518-3c25-42d7-962d-3fc368211499 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:49:58 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:58 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Created reservations ['147de7f5-54c1-4b6e-ad4b-f3fee2609d5f', '9534c205-22d2-4411-8629-e35eebfee8c5', '05e167fa-8dbf-445b-9b4b-bd76649d8e95', '0054d2aa-bea9-4d6d-9004-b8a6adaedc15'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:49:59 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499 1073741824 Apr 29 16:49:59 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d820ee-f989-474c-ad3f-be7c3cb421f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ef6713-70f4-4591-a102-6a0f2521a37d', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67314e08-6d36-46d9-b10a-c7aede8634ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:59 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Volume volume-21ef6713-70f4-4591-a102-6a0f2521a37d (21ef6713-70f4-4591-a102-6a0f2521a37d): created successfully Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67314e08-6d36-46d9-b10a-c7aede8634ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (28b8561c-812f-4968-a92a-578d1a3cd492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-51bf73dc-f38a-4c2f-9499-d6c2fdd77e02 tempest-CreateVolumesFromImageTest-659762052 None] Created volume successfully. Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Flow 'volume_create_manager' (b8946588-ee1b-4452-a94b-64d114c734d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb3b378-26f1-4258-9ffa-c75183f10505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb3b378-26f1-4258-9ffa-c75183f10505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1090274009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c285cd-bd87-4b4d-9ed6-d64a809347ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903470dc65bb4337a4e021eae51f6d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:59Z,use_quota=True,user_id='b3bd4c243803400c96c4953e3bf5162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e589d5b-ea17-49ef-9aa3-7f6afe30059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e589d5b-ea17-49ef-9aa3-7f6afe30059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8054dec8-dc25-40c6-9842-96370255973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8054dec8-dc25-40c6-9842-96370255973c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c285cd-bd87-4b4d-9ed6-d64a809347ad', 'volume_name': 'volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79a3905-01bb-4931-bdfb-0263f21d5178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79a3905-01bb-4931-bdfb-0263f21d5178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37c5c09-2642-4c77-b2f7-8b7cd14da425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:49:59 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Volume 30c285cd-bd87-4b4d-9ed6-d64a809347ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad', 'volume_size': 1} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:59 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:49:59 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:49:59 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499 1073741824" returned: 0 in 0.878s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:59 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.626s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:49:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-aafe51d3-1db3-4b8f-8b70-00d34f61511d tempest-GroupsV314Test-1857754758 None] Delete group completed successfully. Apr 29 16:49:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:49:59 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499 Apr 29 16:49:59 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:00 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499" returned: 0 in 0.673s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.344s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105419331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9126e9-5371-4020-b834-d4924c9ec470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:48Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Creating volume ad9126e9-5371-4020-b834-d4924c9ec470 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:00 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:00 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470 1073741824 Apr 29 16:50:00 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b579980d-04d1-4037-bbc7-d9e690f370fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372a3518-3c25-42d7-962d-3fc368211499', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07274607-09fc-415e-9b27-630905391345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:00 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Volume volume-372a3518-3c25-42d7-962d-3fc368211499 (372a3518-3c25-42d7-962d-3fc368211499): created successfully Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07274607-09fc-415e-9b27-630905391345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (5c38f950-a741-4fcb-8b3d-fe7d91392051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:00 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-80823c7a-4a8f-4843-ad1a-31e90fe393af tempest-CreateVolumesFromImageTest-659762052 None] Created volume successfully. Apr 29 16:50:01 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470 1073741824" returned: 0 in 0.875s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:01 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470 Apr 29 16:50:01 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:02 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470" returned: 0 in 0.656s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.747s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104047919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accaeca6-4ee7-40db-827e-3716c80661a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fd85df688748cb97de67c0aa2d7770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:49Z,use_quota=True,user_id='bc15a3cd903d4c5e965dc4a2b310a2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Creating volume accaeca6-4ee7-40db-827e-3716c80661a5 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:02 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:02 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5 1073741824 Apr 29 16:50:02 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6728852-0937-4d19-b40a-f7b454f9d0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9126e9-5371-4020-b834-d4924c9ec470', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f711ca-b82f-4f49-8548-ee3d18116f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:02 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Volume volume-ad9126e9-5371-4020-b834-d4924c9ec470 (ad9126e9-5371-4020-b834-d4924c9ec470): created successfully Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f711ca-b82f-4f49-8548-ee3d18116f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (a8701756-08ea-4ca0-9696-03f62b8116fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:02 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-39bc0340-37dd-459f-a00b-9900ca966bad tempest-CreateVolumesFromImageTest-659762052 None] Created volume successfully. Apr 29 16:50:03 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5 1073741824" returned: 0 in 0.826s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:03 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5 Apr 29 16:50:03 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:03 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5" returned: 0 in 0.642s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.518s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-346282841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58825e62fe824366bbb83222fc6b4926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:57Z,use_quota=True,user_id='6e28d4aef8a2444aab4b4770fcb5b62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Creating volume 4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:03 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dc1874-efb0-41a0-90cc-8635628f2116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-accaeca6-4ee7-40db-827e-3716c80661a5', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1737387f-c030-442c-83de-d8676fa0b455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:03 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 1073741824 Apr 29 16:50:03 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:03 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Volume volume-accaeca6-4ee7-40db-827e-3716c80661a5 (accaeca6-4ee7-40db-827e-3716c80661a5): created successfully Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1737387f-c030-442c-83de-d8676fa0b455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Flow 'volume_create_manager' (a6a215ca-ceb6-4330-8d64-b35ab58c768f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-1fc08504-20e5-4933-a68a-aba9d4c6db5c tempest-CreateVolumesFromImageTest-659762052 None] Created volume successfully. Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Flow 'volume_create_manager' (1412aa6b-8643-4859-ac82-6b6aa790c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999f8d1f-429f-447c-aedb-9e2a0a9c1a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999f8d1f-429f-447c-aedb-9e2a0a9c1a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-60129391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dd6f4f-7f28-46ea-8916-fcc8bee6835f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea1c36ab3e6446a982809447f5bbb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:04Z,use_quota=True,user_id='a6a37f946a05424c8bfbd8cc3ef51651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb13f59-7952-4b96-92ed-d6469cebc9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb13f59-7952-4b96-92ed-d6469cebc9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6a96ff-4807-496d-be81-6d323c62fd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6a96ff-4807-496d-be81-6d323c62fd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36dd6f4f-7f28-46ea-8916-fcc8bee6835f', 'volume_name': 'volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:04 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3d26ce-28f8-4b80-abcb-03c5f18d1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3d26ce-28f8-4b80-abcb-03c5f18d1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4472b7-0f6e-4dbe-bd62-63e1b7cf3110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:04 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Volume 36dd6f4f-7f28-46ea-8916-fcc8bee6835f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f', 'volume_size': 1} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 1073741824" returned: 0 in 0.903s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:04 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 Apr 29 16:50:04 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-accaeca6-4ee7-40db-827e-3716c80661a5-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-accaeca6-4ee7-40db-827e-3716c80661a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-quobyte-accaeca6-4ee7-40db-827e-3716c80661a5" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-accaeca6-4ee7-40db-827e-3716c80661a5" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e488a3-abe2-48f9-b834-c0bad9d87ec5]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:04 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5 Apr 29 16:50:04 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:05 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6" returned: 0 in 0.619s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.046s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1090274009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c285cd-bd87-4b4d-9ed6-d64a809347ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903470dc65bb4337a4e021eae51f6d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:49:59Z,use_quota=True,user_id='b3bd4c243803400c96c4953e3bf5162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Creating volume 30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:05 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a1800f-31f2-4e73-bc44-b8a35feab22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1748fe-6a76-41a5-8136-bab030822daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:05 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad 1073741824 Apr 29 16:50:05 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:05 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Volume volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 (4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6): created successfully Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1748fe-6a76-41a5-8136-bab030822daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Flow 'volume_create_manager' (48bebb11-7bff-48de-abc9-6e5165290c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:05 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-29b08c7a-30ab-4176-a61a-46526bbdb90f tempest-VolumesListAdminTestJSON-470874475 None] Created volume successfully. Apr 29 16:50:05 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5" returned: 0 in 0.794s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:05 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5 Apr 29 16:50:05 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:06 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad 1073741824" returned: 0 in 0.915s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:06 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad Apr 29 16:50:06 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:50:06 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Flow 'volume_create_manager' (eeff36b9-2239-4ee9-a651-61e91afa82a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdb0902-f7aa-4878-8438-5f4aca3f9617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-accaeca6-4ee7-40db-827e-3716c80661a5" returned: 0 in 0.740s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdb0902-f7aa-4878-8438-5f4aca3f9617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5ff869-9578-4999-8104-3da48042583f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a859b309134f0db7e62830daca2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:06Z,use_quota=True,user_id='00ecbb996f574dd88d704bbb539b6ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b5d4cb-a408-445b-820a-59b1757c48a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b5d4cb-a408-445b-820a-59b1757c48a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f570e90-034c-4149-8477-dab7fc341f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f570e90-034c-4149-8477-dab7fc341f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5ff869-9578-4999-8104-3da48042583f', 'volume_name': 'volume-bd5ff869-9578-4999-8104-3da48042583f', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77ef3f4-1561-41c6-8ac4-6309c7a8e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77ef3f4-1561-41c6-8ac4-6309c7a8e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cf8b38-cfa5-439f-acf2-0b341010621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:06 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Volume bd5ff869-9578-4999-8104-3da48042583f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5ff869-9578-4999-8104-3da48042583f', 'volume_size': 1} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-accaeca6-4ee7-40db-827e-3716c80661a5" released by "delete_volume" :: held 1.626s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Created reservations ['2deec1c1-4870-4d60-918c-61cc3479958e', '397262b9-56dd-404a-a56f-fbd38b963e61', '78bdf9eb-d66f-4019-9386-3f01ac3eedcb', 'ed9ca43f-484f-4ef8-af4b-51f0fbc9635a'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:06 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:06 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:06 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad" returned: 0 in 0.651s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.287s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-60129391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dd6f4f-7f28-46ea-8916-fcc8bee6835f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea1c36ab3e6446a982809447f5bbb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:04Z,use_quota=True,user_id='a6a37f946a05424c8bfbd8cc3ef51651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Creating volume 36dd6f4f-7f28-46ea-8916-fcc8bee6835f {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:06 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37c5c09-2642-4c77-b2f7-8b7cd14da425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:06 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f 1073741824 Apr 29 16:50:06 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad66f68-93bf-41ac-b9a3-c1f7a510f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-ad9126e9-5371-4020-b834-d4924c9ec470-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:06 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Volume volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad (30c285cd-bd87-4b4d-9ed6-d64a809347ad): created successfully Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad66f68-93bf-41ac-b9a3-c1f7a510f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Flow 'volume_create_manager' (b8946588-ee1b-4452-a94b-64d114c734d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-cc7945b0-beb5-4038-be80-d390417ff3bf tempest-VolumeDependencyTests-1838412196 None] Created volume successfully. Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-ad9126e9-5371-4020-b834-d4924c9ec470-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-quobyte-ad9126e9-5371-4020-b834-d4924c9ec470" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-ad9126e9-5371-4020-b834-d4924c9ec470" acquired by "delete_volume" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c83f095-55f3-496b-85dc-1f5eab68c7d5]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:07 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.645s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Deleted volume successfully. Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2f3ec6d5-dddf-4a9e-8f60-e19b3657c905 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-accaeca6-4ee7-40db-827e-3716c80661a5-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:07 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470 Apr 29 16:50:07 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:07 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f 1073741824" returned: 0 in 0.880s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:07 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470" returned: 0 in 0.734s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:07 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f Apr 29 16:50:07 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:07 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470 Apr 29 16:50:07 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:08 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f" returned: 0 in 0.615s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.058s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5ff869-9578-4999-8104-3da48042583f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a859b309134f0db7e62830daca2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:06Z,use_quota=True,user_id='00ecbb996f574dd88d704bbb539b6ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Creating volume bd5ff869-9578-4999-8104-3da48042583f {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:08 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4472b7-0f6e-4dbe-bd62-63e1b7cf3110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:08 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f 1073741824 Apr 29 16:50:08 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11014c43-a7f7-4db9-b58b-75277da5130b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:08 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad9126e9-5371-4020-b834-d4924c9ec470" returned: 0 in 0.643s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:08 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Volume volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f (36dd6f4f-7f28-46ea-8916-fcc8bee6835f): created successfully Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11014c43-a7f7-4db9-b58b-75277da5130b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Flow 'volume_create_manager' (1412aa6b-8643-4859-ac82-6b6aa790c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-ad9126e9-5371-4020-b834-d4924c9ec470" released by "delete_volume" :: held 1.442s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:08 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6c5b1b92-94e0-4f52-a019-97212508fc28 tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Created volume successfully. Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Created reservations ['75e6f1ab-30bc-426a-80ec-2ace8119b8cc', '6d200ff2-e710-421e-a8db-e398b2d7027a', 'a0e9273d-ecc8-4771-8817-036977b844bc', '73893093-72c1-4636-9b6c-6144a24664be'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:08 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:08 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-372a3518-3c25-42d7-962d-3fc368211499-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-372a3518-3c25-42d7-962d-3fc368211499-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-quobyte-372a3518-3c25-42d7-962d-3fc368211499" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-372a3518-3c25-42d7-962d-3fc368211499" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:09 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[379500b6-f8dc-42fa-8692-130fdeae3a75]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f 1073741824" returned: 0 in 0.936s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:09 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.786s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:09 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Deleted volume successfully. Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-24caee59-c930-4e2d-bfbf-17ae642f0eb4 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-ad9126e9-5371-4020-b834-d4924c9ec470-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:09 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f Apr 29 16:50:09 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:09 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499 Apr 29 16:50:09 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Acquiring lock "cinder-36dd6f4f-7f28-46ea-8916-fcc8bee6835f-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "cinder-36dd6f4f-7f28-46ea-8916-fcc8bee6835f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Acquiring lock "cinder-quobyte-36dd6f4f-7f28-46ea-8916-fcc8bee6835f" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "cinder-quobyte-36dd6f4f-7f28-46ea-8916-fcc8bee6835f" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[955432c5-c153-4410-b7c8-4f75f6f1fe6c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:10 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f" returned: 0 in 0.685s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.233s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:10 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f Apr 29 16:50:10 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:10 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Creating offline snapshot 6c0334e7-82ba-40a1-9e97-e028bdca0a79 of volume 30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499" returned: 0 in 0.783s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cf8b38-cfa5-439f-acf2-0b341010621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5ff869-9578-4999-8104-3da48042583f', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb192d23-d759-42de-90b2-19981ddcd57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:10 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499 Apr 29 16:50:10 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c46f31-d950-4913-a10c-f97e238097e1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:10 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Volume volume-bd5ff869-9578-4999-8104-3da48042583f (bd5ff869-9578-4999-8104-3da48042583f): created successfully Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb192d23-d759-42de-90b2-19981ddcd57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Flow 'volume_create_manager' (eeff36b9-2239-4ee9-a651-61e91afa82a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:10 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c541b3a3-f5a9-4985-86af-24e155ce6dd5 tempest-VolumesListAdminTestJSON-2058117966 None] Created volume successfully. Apr 29 16:50:10 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad Apr 29 16:50:10 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Acquiring lock "cinder-bd5ff869-9578-4999-8104-3da48042583f-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Lock "cinder-bd5ff869-9578-4999-8104-3da48042583f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Acquiring lock "cinder-quobyte-bd5ff869-9578-4999-8104-3da48042583f" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Lock "cinder-quobyte-bd5ff869-9578-4999-8104-3da48042583f" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d673d65-e28b-4eea-8576-5d8cef8961bf]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "cinder-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:10 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-372a3518-3c25-42d7-962d-3fc368211499" returned: 0 in 0.696s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-372a3518-3c25-42d7-962d-3fc368211499" released by "delete_volume" :: held 1.581s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "cinder-quobyte-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:10 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f" returned: 0 in 0.931s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:11 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f Apr 29 16:50:11 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-quobyte-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6" acquired by "delete_volume" :: waited 0.057s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:11 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f Apr 29 16:50:11 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5596195-dd23-4a0a-9a76-3f59c04e29ca]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Created reservations ['8de34954-c8a5-4639-a2ef-05c8373edf6e', '078d8569-f8a2-4c44-924e-56423dcd5b8d', '6f473116-3cde-4ce8-9ada-cd8e3a785fe4', '754ee545-d105-439e-abc6-185cc7a613cc'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:11 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad" returned: 0 in 0.894s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:11 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 1G Apr 29 16:50:11 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:11 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 Apr 29 16:50:11 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:11 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:11 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-21ef6713-70f4-4591-a102-6a0f2521a37d-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-21ef6713-70f4-4591-a102-6a0f2521a37d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-quobyte-21ef6713-70f4-4591-a102-6a0f2521a37d" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-21ef6713-70f4-4591-a102-6a0f2521a37d" acquired by "delete_volume" :: waited 0.031s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[479f4109-4de5-478b-aa10-42e7056b9f94]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:11 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d Apr 29 16:50:11 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:11 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f" returned: 0 in 1.143s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:12 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f Apr 29 16:50:12 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:12 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-36dd6f4f-7f28-46ea-8916-fcc8bee6835f" returned: 0 in 1.116s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:12 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6" returned: 0 in 1.041s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "cinder-quobyte-36dd6f4f-7f28-46ea-8916-fcc8bee6835f" released by "delete_volume" :: held 2.120s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:12 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6 Apr 29 16:50:12 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:12 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.022s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Created reservations ['0d266f4a-b1c5-468c-a1ff-d748b62da5b6', 'a1d4c3c6-3841-478e-80d4-dd3431edcc3c', '95df897f-2fc0-48f4-856d-a7f156a6173e', '34e2fb21-e636-4e13-ae4d-c938ca9f1def'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:12 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Deleted volume successfully. Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e8e2e7-17db-43e4-b4b5-6454e8b5fcad tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-372a3518-3c25-42d7-962d-3fc368211499-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:12 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:12 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:12 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 1G" returned: 0 in 1.511s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:12 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 Apr 29 16:50:12 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:12 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d" returned: 0 in 1.121s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:12 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d Apr 29 16:50:12 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:12 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd5ff869-9578-4999-8104-3da48042583f" returned: 0 in 0.942s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Lock "cinder-quobyte-bd5ff869-9578-4999-8104-3da48042583f" released by "delete_volume" :: held 2.150s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Created reservations ['87501cd4-359d-4256-87c2-81a17bee0847', 'b06a238e-c0e2-45ca-bd32-0ecf317daeb0', 'd1e8544e-9fbe-4c6f-82b1-c7a8c6566c11', '160b4858-3b38-40f2-ad20-1011e888b3ad'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:13 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.757s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:13 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Deleted volume successfully. Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9df82f78-c0b7-4c1d-91c7-46b901272bdf tempest-VolumeQuotasNegativeTestJSON-1203099945 None] Lock "cinder-36dd6f4f-7f28-46ea-8916-fcc8bee6835f-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:13 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6" returned: 0 in 1.120s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-quobyte-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6" released by "delete_volume" :: held 2.226s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:13 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:13 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Created reservations ['3df6a05e-45b7-4ba8-9845-0226a1c1c8f7', '7c4cffbc-798d-4d7f-a667-7e6471808e28', '495524c3-6c50-4bd2-8b98-8cb27682ba16', '42446287-6dc8-439f-9368-ea4b1dbc21df'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:13 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:13 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:13 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79" returned: 0 in 0.988s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:13 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 is being set with open permissions: ugo+rw Apr 29 16:50:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:13 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 Apr 29 16:50:13 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:14 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-21ef6713-70f4-4591-a102-6a0f2521a37d" returned: 0 in 1.238s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-21ef6713-70f4-4591-a102-6a0f2521a37d" released by "delete_volume" :: held 2.416s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Created reservations ['c80988b2-81f9-4de2-b8bf-dd5cfa473978', '583040fd-e1d1-4f7b-a1a4-c40c5b8812af', '10bc46d1-9e43-41b3-8550-6b6a31caa70d', '18f32e8c-46d5-416b-8445-d316c5175849'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:14 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.776s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:14 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Deleted volume successfully. Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c195c1b8-e36c-4974-982a-859e47c0f88f tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-4b1dd6d1-3f70-46a1-91bb-7a9e28d9f1c6-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:14 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:14 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:14 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79" returned: 0 in 0.754s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "cinder-2a1ab6c8-304e-4f13-ab11-e0867c440a40-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-2a1ab6c8-304e-4f13-ab11-e0867c440a40-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:14 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.info Apr 29 16:50:14 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:14 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.287s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:14 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Deleted volume successfully. Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "cinder-quobyte-2a1ab6c8-304e-4f13-ab11-e0867c440a40" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-quobyte-2a1ab6c8-304e-4f13-ab11-e0867c440a40" acquired by "delete_volume" :: waited 0.034s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6a4aec68-45ae-4d8c-a1b1-f46c8c447c7b tempest-VolumesListAdminTestJSON-2058117966 None] Lock "cinder-bd5ff869-9578-4999-8104-3da48042583f-delete_volume" released by "delete_volume" :: held 3.894s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aedbdc-03af-4773-b05c-234056500681]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:14 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 Apr 29 16:50:14 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-1cf65338-8b96-4b75-a439-2f972bdeec01-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-1cf65338-8b96-4b75-a439-2f972bdeec01-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:15 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:15 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.info" returned: 0 in 0.733s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:15 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.info is being set with open permissions: ugo+rw Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.882s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Deleted volume successfully. Apr 29 16:50:15 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.info Apr 29 16:50:15 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "cinder-quobyte-1cf65338-8b96-4b75-a439-2f972bdeec01" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-12f67a37-5017-4943-8ac8-e016a38a0163 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-21ef6713-70f4-4591-a102-6a0f2521a37d-delete_volume" released by "delete_volume" :: held 3.708s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-1cf65338-8b96-4b75-a439-2f972bdeec01" acquired by "delete_volume" :: waited 0.043s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53d0ce5-36e3-4af8-b1b5-f10bd4dd9523]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:15 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01 Apr 29 16:50:15 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:15 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40" returned: 0 in 0.977s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:15 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40 Apr 29 16:50:15 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:15 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.info" returned: 0 in 0.714s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.757s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f4aaf4e4-66d1-4319-b163-b528b9e65648 tempest-VolumeDependencyTests-1838412196 None] Create snapshot completed successfully Apr 29 16:50:16 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01" returned: 0 in 0.917s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:16 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01 Apr 29 16:50:16 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:16 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2a1ab6c8-304e-4f13-ab11-e0867c440a40" returned: 0 in 0.711s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-quobyte-2a1ab6c8-304e-4f13-ab11-e0867c440a40" released by "delete_volume" :: held 1.743s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Created reservations ['f56a12ce-9f03-481e-8b72-fb82eecae056', '1ce39020-f026-47e5-89eb-af1818554245', '3ed2b3f4-97da-4320-a344-ed20adfed9e3', '31e36441-aa94-4d56-9f03-d3a6c017a0db'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:16 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:16 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "cinder-5b0a6136-b4c1-4076-86f1-2eb3f76201df-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-5b0a6136-b4c1-4076-86f1-2eb3f76201df-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "cinder-quobyte-5b0a6136-b4c1-4076-86f1-2eb3f76201df" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-quobyte-5b0a6136-b4c1-4076-86f1-2eb3f76201df" acquired by "delete_volume" :: waited 0.038s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc76cdb-b30c-47fe-a4ab-65ca820133d0]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:50:17 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1cf65338-8b96-4b75-a439-2f972bdeec01" returned: 0 in 0.904s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-quobyte-1cf65338-8b96-4b75-a439-2f972bdeec01" released by "delete_volume" :: held 1.880s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Flow 'volume_create_manager' (e54384c8-0874-41b7-9638-0eab57cedcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9f11ac-d7b2-4d96-a923-dbeb5d24bee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9f11ac-d7b2-4d96-a923-dbeb5d24bee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1458693387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6786cd1d-9205-4fd0-8b74-be3447009eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903470dc65bb4337a4e021eae51f6d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6c0334e7-82ba-40a1-9e97-e028bdca0a79,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:17Z,use_quota=True,user_id='b3bd4c243803400c96c4953e3bf5162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a00e216-4335-455d-a3b2-dac229b81c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a00e216-4335-455d-a3b2-dac229b81c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:17 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df Apr 29 16:50:17 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f544fd-dfaa-46d8-b921-b186c57da296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f544fd-dfaa-46d8-b921-b186c57da296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6786cd1d-9205-4fd0-8b74-be3447009eae', 'volume_name': 'volume-6786cd1d-9205-4fd0-8b74-be3447009eae', 'volume_size': 1, 'snapshot_id': '6c0334e7-82ba-40a1-9e97-e028bdca0a79'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fd35b2-8464-42d1-b131-972e8dc33ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fd35b2-8464-42d1-b131-972e8dc33ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56c8388-2221-4e1c-a0e4-bd29fec4dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:17 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Volume 6786cd1d-9205-4fd0-8b74-be3447009eae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6786cd1d-9205-4fd0-8b74-be3447009eae', 'volume_size': 1, 'snapshot_id': '6c0334e7-82ba-40a1-9e97-e028bdca0a79'} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-6c0334e7-82ba-40a1-9e97-e028bdca0a79-6786cd1d-9205-4fd0-8b74-be3447009eae" by "_create_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-6c0334e7-82ba-40a1-9e97-e028bdca0a79-6786cd1d-9205-4fd0-8b74-be3447009eae" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Creating volume 6786cd1d-9205-4fd0-8b74-be3447009eae from snapshot 6c0334e7-82ba-40a1-9e97-e028bdca0a79 {{(pid=84201) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-6786cd1d-9205-4fd0-8b74-be3447009eae" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Created reservations ['5e51e486-fb16-49cd-ac50-80b4b13d2b3a', '90591ce2-5274-4665-bd1d-9b3136d73f20', 'cbae349c-5532-4525-8e97-251a86171690', '6c24b2b3-f604-4a80-b32c-ef1691703012'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-6786cd1d-9205-4fd0-8b74-be3447009eae" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] snapshot: 6c0334e7-82ba-40a1-9e97-e028bdca0a79, volume: 6786cd1d-9205-4fd0-8b74-be3447009eae, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:50:17 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.001s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:17 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Deleted volume successfully. Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e5324-4790-42e3-9c3f-63ae52fd6eb5]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e16c01db-ba2d-4730-9568-4b0aa1364645 tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-2a1ab6c8-304e-4f13-ab11-e0867c440a40-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:17 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:17 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:17 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 Apr 29 16:50:17 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:17 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df" returned: 0 in 0.833s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:17 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df Apr 29 16:50:17 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:18 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.667s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:18 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Deleted volume successfully. Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29a335cf-fbaf-4d2c-91e4-298e685b9039 tempest-CreateVolumesFromImageTest-659762052 None] Lock "cinder-1cf65338-8b96-4b75-a439-2f972bdeec01-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:18 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79" returned: 0 in 0.948s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0b4cee-78cb-402b-a6f4-b293c98ecf84]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:18 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad Apr 29 16:50:18 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:18 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5b0a6136-b4c1-4076-86f1-2eb3f76201df" returned: 0 in 0.679s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-quobyte-5b0a6136-b4c1-4076-86f1-2eb3f76201df" released by "delete_volume" :: held 1.581s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Created reservations ['67efe69d-ed9a-43e2-b25a-2305c27f7f15', '41098ce5-2d97-434b-8a7b-c2ac5ea4a01d', 'a6b8b3e3-ae85-4634-a51c-c67966210700', 'bace289a-6697-4364-81db-f61ee4f7220f'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:18 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:18 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:19 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad" returned: 0 in 0.896s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:19 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:50:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:19 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae Apr 29 16:50:19 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:19 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.741s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:19 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:19 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Deleted volume successfully. Apr 29 16:50:19 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f48c088e-17a9-46c2-9cb5-ebcd2edd0278 tempest-VolumesListAdminTestJSON-470874475 None] Lock "cinder-5b0a6136-b4c1-4076-86f1-2eb3f76201df-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:20 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:50:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Flow 'volume_create_manager' (11d6f8b2-3a35-4fe9-b18e-4349329c110f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98aa4593-e442-4ad9-91b0-13bf2656f9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98aa4593-e442-4ad9-91b0-13bf2656f9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1341974408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d48d2e7-6787-4311-bc44-4edb47c07698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d597e6f3e54b8dbcca98e0187006f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:21Z,use_quota=True,user_id='d85c82c63f0146a7a69291f8c07083f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cb2051-2d5d-43dd-8c14-3618827294e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cb2051-2d5d-43dd-8c14-3618827294e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0a165d-db8c-4ccf-b45e-d3c6e7c8edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0a165d-db8c-4ccf-b45e-d3c6e7c8edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d48d2e7-6787-4311-bc44-4edb47c07698', 'volume_name': 'volume-8d48d2e7-6787-4311-bc44-4edb47c07698', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5324bde-b789-4c96-b9ef-4b39b37a68cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5324bde-b789-4c96-b9ef-4b39b37a68cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e45719-87d4-4cfe-bdda-5a365891315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:21 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Volume 8d48d2e7-6787-4311-bc44-4edb47c07698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d48d2e7-6787-4311-bc44-4edb47c07698', 'volume_size': 1} Apr 29 16:50:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:25 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae" returned: 0 in 5.794s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:25 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf84e0ef-6c70-42c5-acce-169638bae853]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:25 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad Apr 29 16:50:25 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:26 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad" returned: 0 in 0.866s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:50:26 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Converted 1024.00 MB image at 176.63 MB/s Apr 29 16:50:26 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae is being set with open permissions: ugo+rw Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:26 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae Apr 29 16:50:26 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:26 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae" returned: 0 in 0.636s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-6786cd1d-9205-4fd0-8b74-be3447009eae" released by "_copy_volume_from_snapshot" :: held 9.282s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-6c0334e7-82ba-40a1-9e97-e028bdca0a79-6786cd1d-9205-4fd0-8b74-be3447009eae" released by "_create_volume_from_snapshot" :: held 9.359s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.392s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.590s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1341974408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d48d2e7-6787-4311-bc44-4edb47c07698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d597e6f3e54b8dbcca98e0187006f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:21Z,use_quota=True,user_id='d85c82c63f0146a7a69291f8c07083f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Creating volume 8d48d2e7-6787-4311-bc44-4edb47c07698 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:26 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:INSERT=59,cinder:UPDATE=239,cinder:DELETE=16,cinder:SELECT=176 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:50:26 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698 1073741824 Apr 29 16:50:26 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=229,cinder:DELETE=19,cinder:SELECT=159,cinder:INSERT=54 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56c8388-2221-4e1c-a0e4-bd29fec4dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6786cd1d-9205-4fd0-8b74-be3447009eae', 'volume_size': 1, 'snapshot_id': '6c0334e7-82ba-40a1-9e97-e028bdca0a79'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfda6c9-4dc4-483b-a78a-9a29350c2440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:26 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Volume volume-6786cd1d-9205-4fd0-8b74-be3447009eae (6786cd1d-9205-4fd0-8b74-be3447009eae): created successfully Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfda6c9-4dc4-483b-a78a-9a29350c2440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:26 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Flow 'volume_create_manager' (e54384c8-0874-41b7-9638-0eab57cedcb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:26 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-70e4f07e-90c2-41c5-81bc-1e811f7e3860 tempest-VolumeDependencyTests-1838412196 None] Created volume successfully. Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-6c0334e7-82ba-40a1-9e97-e028bdca0a79-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-6c0334e7-82ba-40a1-9e97-e028bdca0a79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-30c285cd-bd87-4b4d-9ed6-d64a809347ad" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-30c285cd-bd87-4b4d-9ed6-d64a809347ad" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-6c0334e7-82ba-40a1-9e97-e028bdca0a79" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-6c0334e7-82ba-40a1-9e97-e028bdca0a79" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Deleting offline snapshot 6c0334e7-82ba-40a1-9e97-e028bdca0a79 of volume 30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] snapshot_file for this snap is: volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cdb09a-b70f-4dba-afd4-9968fdc7a301]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:27 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 Apr 29 16:50:27 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:27 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698 1073741824" returned: 0 in 0.832s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:27 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698 Apr 29 16:50:27 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:27 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79" returned: 0 in 0.769s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[251f800b-083e-4122-bea3-66938047312e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:28 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad Apr 29 16:50:28 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:28 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698" returned: 0 in 0.620s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e45719-87d4-4cfe-bdda-5a365891315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d48d2e7-6787-4311-bc44-4edb47c07698', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba8d049-98ed-4398-a34b-0b9918b39757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:28 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Volume volume-8d48d2e7-6787-4311-bc44-4edb47c07698 (8d48d2e7-6787-4311-bc44-4edb47c07698): created successfully Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba8d049-98ed-4398-a34b-0b9918b39757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Flow 'volume_create_manager' (11d6f8b2-3a35-4fe9-b18e-4349329c110f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:28 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-18a10668-ddf1-4b5c-bd10-334f5207bf1d tempest-VolumesServicesTestJSON-1301788561 None] Created volume successfully. Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Acquiring lock "cinder-8d48d2e7-6787-4311-bc44-4edb47c07698-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Lock "cinder-8d48d2e7-6787-4311-bc44-4edb47c07698-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Acquiring lock "cinder-quobyte-8d48d2e7-6787-4311-bc44-4edb47c07698" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Lock "cinder-quobyte-8d48d2e7-6787-4311-bc44-4edb47c07698" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[95034bea-407a-4342-b8ae-d20424892425]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:28 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698 Apr 29 16:50:28 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:28 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad" returned: 0 in 0.800s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:28 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 Apr 29 16:50:28 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:29 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698" returned: 0 in 0.758s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:29 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698 Apr 29 16:50:29 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:29 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79" returned: 0 in 0.752s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:29 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79 Apr 29 16:50:29 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:29 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8d48d2e7-6787-4311-bc44-4edb47c07698" returned: 0 in 0.619s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Lock "cinder-quobyte-8d48d2e7-6787-4311-bc44-4edb47c07698" released by "delete_volume" :: held 1.429s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Created reservations ['3c83a664-1bd7-4d03-8b9a-c12f59672a44', 'e06feeed-8148-45bd-bb51-46fbcb940537', 'cce607cc-43bb-40a5-978e-aab3e81dc375', 'eb107ef6-9e2c-4847-a379-fe704daac1d2'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:30 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:30 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:30 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad.6c0334e7-82ba-40a1-9e97-e028bdca0a79" returned: 0 in 0.650s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-6c0334e7-82ba-40a1-9e97-e028bdca0a79" released by "_delete_snapshot" :: held 3.111s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-30c285cd-bd87-4b4d-9ed6-d64a809347ad" released by "delete_snapshot" :: held 3.152s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Created reservations ['8bf35d62-e541-4c0b-92fa-35ee91dabd7b', 'c524db2a-075e-4a4e-8e78-70272dd16e70', '6df5e5f5-a5a1-40a0-b170-bc777802a4af', '2433999e-a703-4810-acd4-500bcd5d5dfd'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Delete snapshot completed successfully. Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7a08cf8d-af97-4f75-8986-a2865e0cf15d tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-6c0334e7-82ba-40a1-9e97-e028bdca0a79-delete_snapshot" released by "delete_snapshot" :: held 3.293s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Flow 'volume_create_manager' (eaa2b280-9f9b-4d34-8b1e-50fa6f079c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4880d5-46cd-403c-a306-9805a8bfb636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4880d5-46cd-403c-a306-9805a8bfb636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-212567107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5474b630e2040a5802e399d8b415dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:31Z,use_quota=True,user_id='c2647859c53d455bbbc94fb22cd95157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b07b83-d869-428f-a607-18c2d9f39d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b07b83-d869-428f-a607-18c2d9f39d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b0f24-0c29-4f83-8848-7592c66ece68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b0f24-0c29-4f83-8848-7592c66ece68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec', 'volume_name': 'volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658ae12a-402a-408c-8c19-140a41b759d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658ae12a-402a-408c-8c19-140a41b759d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079338dd-a526-4b08-a982-b6ea020f59e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:30 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Volume 6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec', 'volume_size': 1} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-212567107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5474b630e2040a5802e399d8b415dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:31Z,use_quota=True,user_id='c2647859c53d455bbbc94fb22cd95157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Creating volume 6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:30 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:30 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec 1073741824 Apr 29 16:50:30 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:30 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.630s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Deleted volume successfully. Apr 29 16:50:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-29629427-eedd-4bc9-9cb3-eafe9c3cd068 tempest-VolumesServicesTestJSON-1301788561 None] Lock "cinder-8d48d2e7-6787-4311-bc44-4edb47c07698-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-30c285cd-bd87-4b4d-9ed6-d64a809347ad-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-30c285cd-bd87-4b4d-9ed6-d64a809347ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-30c285cd-bd87-4b4d-9ed6-d64a809347ad" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-30c285cd-bd87-4b4d-9ed6-d64a809347ad" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:31 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a479cc45-b792-4c54-af80-faf8ff729f45]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:31 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad Apr 29 16:50:31 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:31 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec 1073741824" returned: 0 in 0.913s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:31 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec Apr 29 16:50:31 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:32 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad" returned: 0 in 0.763s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:32 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad Apr 29 16:50:32 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:32 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec" returned: 0 in 0.664s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079338dd-a526-4b08-a982-b6ea020f59e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c82f14f-9db2-41bc-8bc4-4e84ba017cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:32 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Volume volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec (6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec): created successfully Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c82f14f-9db2-41bc-8bc4-4e84ba017cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Flow 'volume_create_manager' (eaa2b280-9f9b-4d34-8b1e-50fa6f079c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:32 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c364834f-f4c1-4720-a18f-41373b52d044 tempest-VolumesTransfersTest-428614525 None] Created volume successfully. Apr 29 16:50:32 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-30c285cd-bd87-4b4d-9ed6-d64a809347ad" returned: 0 in 0.674s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-30c285cd-bd87-4b4d-9ed6-d64a809347ad" released by "delete_volume" :: held 1.518s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:32 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Created reservations ['4817a29f-d16f-458d-bffe-5c08ff0f5925', '6123409c-87eb-4402-9ab3-8db7190468f9', 'cf9b81aa-640c-43e7-9550-1a9d4e633d13', 'ba70c87a-643c-458a-a241-efefa3ec13da'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:33 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:33 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-bfcb18b2-f43a-49b1-9d14-7ec04fefe8e6 tempest-VolumesTransfersTest-117291667 None] Transfer volume completed successfully. Apr 29 16:50:33 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.690s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:33 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Deleted volume successfully. Apr 29 16:50:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5edf91c8-a34f-4b94-badb-6847b88eff9f tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-30c285cd-bd87-4b4d-9ed6-d64a809347ad-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Flow 'volume_create_manager' (38ed5ad3-0b46-4c24-8e35-20977b71ee04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206c8f10-d53a-4ff1-988e-27b131253352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206c8f10-d53a-4ff1-988e-27b131253352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1525828903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f941ee-e841-4b9d-916d-fe01ef0cc3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903470dc65bb4337a4e021eae51f6d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:34Z,use_quota=True,user_id='b3bd4c243803400c96c4953e3bf5162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b7883b-d4cf-4e16-9d2c-20c0b4b0765a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b7883b-d4cf-4e16-9d2c-20c0b4b0765a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5f8387-e39a-4da3-b32a-d6fd0c0c67be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5f8387-e39a-4da3-b32a-d6fd0c0c67be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f941ee-e841-4b9d-916d-fe01ef0cc3dd', 'volume_name': 'volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ad4723-9579-4b03-8138-bba29241e00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ad4723-9579-4b03-8138-bba29241e00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6455257-9655-4002-9d89-03d9c505e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:34 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Volume 94f941ee-e841-4b9d-916d-fe01ef0cc3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd', 'volume_size': 1} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1525828903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f941ee-e841-4b9d-916d-fe01ef0cc3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903470dc65bb4337a4e021eae51f6d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:34Z,use_quota=True,user_id='b3bd4c243803400c96c4953e3bf5162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Creating volume 94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:34 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:34 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd 1073741824 Apr 29 16:50:34 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Acquiring lock "cinder-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Lock "cinder-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Acquiring lock "cinder-quobyte-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Lock "cinder-quobyte-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[103bbad7-0c8e-4d0b-8ce8-ea48cbd6a615]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:34 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd 1073741824" returned: 0 in 0.841s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:34 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec Apr 29 16:50:34 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:35 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd Apr 29 16:50:35 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:35 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec" returned: 0 in 0.739s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:35 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec Apr 29 16:50:35 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:35 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" returned: 0 in 0.659s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6455257-9655-4002-9d89-03d9c505e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba5896e-76b4-4a75-b95f-80f0b0b108fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:35 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Volume volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd (94f941ee-e841-4b9d-916d-fe01ef0cc3dd): created successfully Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba5896e-76b4-4a75-b95f-80f0b0b108fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Flow 'volume_create_manager' (38ed5ad3-0b46-4c24-8e35-20977b71ee04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b0232cf4-d334-4953-b512-dc2435081096 tempest-VolumeDependencyTests-1838412196 None] Created volume successfully. Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Flow 'volume_create_manager' (46c06eb2-f70b-4f9f-b311-0cdfcf21bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda3e70a-4e54-426a-aadf-58b03fd925c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda3e70a-4e54-426a-aadf-58b03fd925c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1703149388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bffe5a-279c-4149-9559-0892d12419bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1062c41e70e94892af4dc6a1cf7e2286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:36Z,use_quota=True,user_id='d984dd4c0e9c42ab85af297cf18dc764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c42db49-9b41-4816-8e91-81e077225764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c42db49-9b41-4816-8e91-81e077225764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dae8f35-845c-42b2-9f19-b523f3c6d064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dae8f35-845c-42b2-9f19-b523f3c6d064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5bffe5a-279c-4149-9559-0892d12419bd', 'volume_name': 'volume-f5bffe5a-279c-4149-9559-0892d12419bd', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb346b9c-7918-421b-a76f-6c34d25250ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb346b9c-7918-421b-a76f-6c34d25250ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1a5c92-a5f0-4c20-ac39-c7189658d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Volume f5bffe5a-279c-4149-9559-0892d12419bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5bffe5a-279c-4149-9559-0892d12419bd', 'volume_size': 1} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1703149388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bffe5a-279c-4149-9559-0892d12419bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1062c41e70e94892af4dc6a1cf7e2286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:36Z,use_quota=True,user_id='d984dd4c0e9c42ab85af297cf18dc764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Creating volume f5bffe5a-279c-4149-9559-0892d12419bd {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:36 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec" returned: 0 in 0.651s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:36 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd 1073741824 Apr 29 16:50:36 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Lock "cinder-quobyte-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec" released by "delete_volume" :: held 1.440s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Created reservations ['7a7b60ce-669d-463f-9fa3-24f2582df824', 'f75b5590-8c29-4cec-8693-420a7e06293f', 'f94d2c02-3f98-41ff-a251-68d329c85506', '9c7a442b-db07-44d0-a3d6-09c0a135fcd0'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:36 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:36 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Flow 'volume_create_manager' (8429b49c-c968-4aa0-b775-08fe5041073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb1a3ab-5407-40cf-a866-f699d943e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb1a3ab-5407-40cf-a866-f699d943e48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1382686698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b799a2-b8da-4fec-882e-d54fb7676e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903470dc65bb4337a4e021eae51f6d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=94f941ee-e841-4b9d-916d-fe01ef0cc3dd,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:37Z,use_quota=True,user_id='b3bd4c243803400c96c4953e3bf5162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb851b4-3f53-4d8c-afb9-a75617753fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb851b4-3f53-4d8c-afb9-a75617753fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400679a3-d2d2-4637-9cab-3087d5d87be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400679a3-d2d2-4637-9cab-3087d5d87be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85b799a2-b8da-4fec-882e-d54fb7676e0d', 'volume_name': 'volume-85b799a2-b8da-4fec-882e-d54fb7676e0d', 'volume_size': 1, 'source_volid': '94f941ee-e841-4b9d-916d-fe01ef0cc3dd', 'source_volstatus': 'available'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b94e079-e723-46cf-8c25-c1292fc6425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b94e079-e723-46cf-8c25-c1292fc6425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e72a152-f6a4-4ad4-b5d3-9b78e95eaa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:36 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Volume 85b799a2-b8da-4fec-882e-d54fb7676e0d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85b799a2-b8da-4fec-882e-d54fb7676e0d', 'volume_size': 1, 'source_volid': '94f941ee-e841-4b9d-916d-fe01ef0cc3dd', 'source_volstatus': 'available'} Apr 29 16:50:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:37 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.657s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:37 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Deleted volume successfully. Apr 29 16:50:37 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd 1073741824" returned: 0 in 0.842s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ad17c624-c320-4cf4-9e00-896f672ff143 tempest-VolumesTransfersTest-92526561 None] Lock "cinder-6dd0f16c-34b5-4ac5-a81d-99c3ca2e2bec-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:37 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd Apr 29 16:50:37 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Flow 'volume_create_manager' (c555bbc5-884b-4d80-96b7-df3a4100af66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a114586c-2888-4b71-9a9f-a639ad30d4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a114586c-2888-4b71-9a9f-a639ad30d4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1356095090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b13297-972a-453b-8903-cbd822605009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5474b630e2040a5802e399d8b415dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:37Z,use_quota=True,user_id='c2647859c53d455bbbc94fb22cd95157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329d4198-8681-4aa5-adec-06ed6b087ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329d4198-8681-4aa5-adec-06ed6b087ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e2c560-a665-4e91-8bca-2c4bc3e18b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e2c560-a665-4e91-8bca-2c4bc3e18b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b13297-972a-453b-8903-cbd822605009', 'volume_name': 'volume-44b13297-972a-453b-8903-cbd822605009', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d1c40c-0b08-484a-a270-f97361941288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d1c40c-0b08-484a-a270-f97361941288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd5b87c-890c-4a76-bf15-83d67b4b1258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:37 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Volume 44b13297-972a-453b-8903-cbd822605009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b13297-972a-453b-8903-cbd822605009', 'volume_size': 1} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:37 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd" returned: 0 in 0.619s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.949s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:37 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Cloning volume 94f941ee-e841-4b9d-916d-fe01ef0cc3dd to volume 85b799a2-b8da-4fec-882e-d54fb7676e0d Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1a5c92-a5f0-4c20-ac39-c7189658d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5bffe5a-279c-4149-9559-0892d12419bd', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0966553c-e328-49a3-8f3f-fe0839d9a0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:37 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Volume volume-f5bffe5a-279c-4149-9559-0892d12419bd (f5bffe5a-279c-4149-9559-0892d12419bd): created successfully Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0966553c-e328-49a3-8f3f-fe0839d9a0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Flow 'volume_create_manager' (46c06eb2-f70b-4f9f-b311-0cdfcf21bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Creating offline snapshot 8548f3ed-5643-4636-9047-c04d83836a49 of volume 94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:50:37 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-acccf9ed-e1b0-4c56-bb37-cf3c2bc9a50d tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Created volume successfully. Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcedb1e-bec5-4122-acfe-f6ab83bcd853]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:37 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd Apr 29 16:50:37 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:38 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" returned: 0 in 0.754s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:38 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 1G Apr 29 16:50:38 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:39 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 1G" returned: 0 in 0.771s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:39 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 Apr 29 16:50:39 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:39 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49" returned: 0 in 0.642s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:39 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 is being set with open permissions: ugo+rw Apr 29 16:50:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:40 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 Apr 29 16:50:40 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:40 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49" returned: 0 in 0.583s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:40 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.info Apr 29 16:50:40 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:41 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.info" returned: 0 in 0.594s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:41 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.info is being set with open permissions: ugo+rw Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:41 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.info Apr 29 16:50:41 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:41 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.info" returned: 0 in 0.579s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-85b799a2-b8da-4fec-882e-d54fb7676e0d" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-85b799a2-b8da-4fec-882e-d54fb7676e0d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] snapshot: 8548f3ed-5643-4636-9047-c04d83836a49, volume: 85b799a2-b8da-4fec-882e-d54fb7676e0d, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2104b7d2-c2a1-4264-a347-257805c8488f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:41 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 Apr 29 16:50:41 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:42 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49" returned: 0 in 0.687s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:50:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:50:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:50:42 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf15b76d-35be-4fa1-9b14-736ca035dfb7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:42 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd Apr 29 16:50:42 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:43 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" returned: 0 in 0.686s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:43 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:50:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:43 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d Apr 29 16:50:43 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:47 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d" returned: 0 in 4.490s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:47 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc81797-0dd1-4896-a1eb-24634ecde1f9]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:47 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd Apr 29 16:50:47 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:48 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" returned: 0 in 0.839s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:48 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd, size 1024.00 MB, duration 4.49 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:50:48 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Converted 1024.00 MB image at 228.02 MB/s Apr 29 16:50:48 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d is being set with open permissions: ugo+rw Apr 29 16:50:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:48 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d Apr 29 16:50:48 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:49 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d" returned: 0 in 0.593s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-85b799a2-b8da-4fec-882e-d54fb7676e0d" released by "_copy_volume_from_snapshot" :: held 7.380s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-8548f3ed-5643-4636-9047-c04d83836a49" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-8548f3ed-5643-4636-9047-c04d83836a49" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Deleting offline snapshot 8548f3ed-5643-4636-9047-c04d83836a49 of volume 94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] snapshot_file for this snap is: volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eafc160-b7f6-489c-9329-a2f3df269e59]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:49 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 Apr 29 16:50:49 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:49 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49" returned: 0 in 0.723s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:50:50 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b042be7-6f6f-49f2-b12c-6980975e377c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:50 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd Apr 29 16:50:50 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:50 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=40,cinder:SELECT=40,cinder:INSERT=11,cinder:DELETE=3 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:50:50 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" returned: 0 in 0.705s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:50 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 Apr 29 16:50:50 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:51 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49" returned: 0 in 0.664s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:51 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49 Apr 29 16:50:51 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:51 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd.8548f3ed-5643-4636-9047-c04d83836a49" returned: 0 in 0.590s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-8548f3ed-5643-4636-9047-c04d83836a49" released by "_delete_snapshot" :: held 2.775s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.283s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.516s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1356095090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b13297-972a-453b-8903-cbd822605009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5474b630e2040a5802e399d8b415dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:50:37Z,use_quota=True,user_id='c2647859c53d455bbbc94fb22cd95157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Creating volume 44b13297-972a-453b-8903-cbd822605009 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:50:52 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:52 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009 1073741824 Apr 29 16:50:52 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e72a152-f6a4-4ad4-b5d3-9b78e95eaa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b799a2-b8da-4fec-882e-d54fb7676e0d', 'volume_size': 1, 'source_volid': '94f941ee-e841-4b9d-916d-fe01ef0cc3dd', 'source_volstatus': 'available'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c092e16d-8ae1-44dc-8151-78312ab88dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:52 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Volume volume-85b799a2-b8da-4fec-882e-d54fb7676e0d (85b799a2-b8da-4fec-882e-d54fb7676e0d): created successfully Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c092e16d-8ae1-44dc-8151-78312ab88dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Flow 'volume_create_manager' (8429b49c-c968-4aa0-b775-08fe5041073a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-16e3092a-a564-408f-a8f2-cce62f86410a tempest-VolumeDependencyTests-1838412196 None] Created volume successfully. Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-94f941ee-e841-4b9d-916d-fe01ef0cc3dd-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-94f941ee-e841-4b9d-916d-fe01ef0cc3dd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:52 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009 1073741824" returned: 0 in 0.763s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ea58a-f26c-47ab-a526-fe0c07c350d8]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:52 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009 Apr 29 16:50:52 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:52 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd Apr 29 16:50:52 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:53 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009" returned: 0 in 0.607s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.003s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Creating offline snapshot a36b05a9-8b57-4b35-b5ed-82236514e9bd of volume f5bffe5a-279c-4149-9559-0892d12419bd {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd5b87c-890c-4a76-bf15-83d67b4b1258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b13297-972a-453b-8903-cbd822605009', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e303ae05-a4fb-4cc4-b2ae-b6daece291d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f62c3a5-3906-44c2-b094-a47be91e2d78]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:53 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Volume volume-44b13297-972a-453b-8903-cbd822605009 (44b13297-972a-453b-8903-cbd822605009): created successfully Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e303ae05-a4fb-4cc4-b2ae-b6daece291d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Flow 'volume_create_manager' (c555bbc5-884b-4d80-96b7-df3a4100af66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:50:53 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" returned: 0 in 0.723s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:53 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0c4991de-0045-442a-9d4f-ee21121b7918 tempest-VolumesTransfersTest-428614525 None] Created volume successfully. Apr 29 16:50:53 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd Apr 29 16:50:53 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:53 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd Apr 29 16:50:53 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:54 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" returned: 0 in 0.620s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-94f941ee-e841-4b9d-916d-fe01ef0cc3dd" released by "delete_volume" :: held 1.407s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:54 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd" returned: 0 in 0.716s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:54 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd 1G Apr 29 16:50:54 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Created reservations ['a3d8cd3a-0dd8-4d36-b504-3ab2b68816cb', '2faa65f2-841d-43f1-ab0c-de4fe9ec6579', '81ebaced-da8b-4b69-b615-782b40bf8c3c', '0faeb152-0790-482b-b109-568db48add15'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:54 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:54 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Acquiring lock "cinder-44b13297-972a-453b-8903-cbd822605009-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Lock "cinder-44b13297-972a-453b-8903-cbd822605009-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Acquiring lock "cinder-quobyte-44b13297-972a-453b-8903-cbd822605009" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Lock "cinder-quobyte-44b13297-972a-453b-8903-cbd822605009" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d75431-5e9a-480b-b0b9-fcacc273df36]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-85b799a2-b8da-4fec-882e-d54fb7676e0d-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-85b799a2-b8da-4fec-882e-d54fb7676e0d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:55 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.714s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:55 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Deleted volume successfully. Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c59ed29c-6488-4573-92e3-2446a18ccbb4 tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-94f941ee-e841-4b9d-916d-fe01ef0cc3dd-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-85b799a2-b8da-4fec-882e-d54fb7676e0d" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-85b799a2-b8da-4fec-882e-d54fb7676e0d" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c123e-180b-4103-a6f1-f3ee2ec396f7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:55 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd 1G" returned: 0 in 0.927s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5bffe5a-279c-4149-9559-0892d12419bd -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:55 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009 Apr 29 16:50:55 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:55 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5bffe5a-279c-4149-9559-0892d12419bd -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd Apr 29 16:50:55 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:55 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d Apr 29 16:50:55 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:55 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009" returned: 0 in 0.785s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:55 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5bffe5a-279c-4149-9559-0892d12419bd -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd" returned: 0 in 0.629s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:55 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd is being set with open permissions: ugo+rw Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:55 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009 Apr 29 16:50:55 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:55 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd Apr 29 16:50:55 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:55 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d" returned: 0 in 0.734s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:55 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d Apr 29 16:50:55 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:56 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd" returned: 0 in 0.594s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:56 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-44b13297-972a-453b-8903-cbd822605009" returned: 0 in 0.667s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:56 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.info Apr 29 16:50:56 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Lock "cinder-quobyte-44b13297-972a-453b-8903-cbd822605009" released by "delete_volume" :: held 1.504s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Created reservations ['5d83a676-6d4e-4479-96a7-9a96e4b84d9d', '41385b50-f042-4550-98dc-79789cceaea1', '019520fc-9583-4f23-9877-640ec665a1b5', 'f2bfba6b-a3da-45a6-8a34-ef07ae722ebc'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:56 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-85b799a2-b8da-4fec-882e-d54fb7676e0d" returned: 0 in 0.661s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-85b799a2-b8da-4fec-882e-d54fb7676e0d" released by "delete_volume" :: held 1.445s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Created reservations ['4cb11ad6-4167-4eeb-96e0-243fa680628b', '3ef0da1e-3d61-4ca1-87bf-f46bb07e8e74', '8b6ed5e4-0f9f-414b-a3f4-c2b44b9aeaec', '736bda66-e256-4be8-a6eb-e87a2353bae1'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:56 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:56 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:56 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:56 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:57 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.info" returned: 0 in 0.616s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:57 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.info is being set with open permissions: ugo+rw Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:57 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.info Apr 29 16:50:57 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:57 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.709s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Deleted volume successfully. Apr 29 16:50:57 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.702s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Deleted volume successfully. Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b0db0f3d-655f-4065-97db-a279731d73ae tempest-VolumesTransfersTest-92526561 None] Lock "cinder-44b13297-972a-453b-8903-cbd822605009-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c8a9df02-ab16-4263-b0f5-0eaa0fadc96e tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-85b799a2-b8da-4fec-882e-d54fb7676e0d-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-6786cd1d-9205-4fd0-8b74-be3447009eae-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-6786cd1d-9205-4fd0-8b74-be3447009eae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "cinder-quobyte-6786cd1d-9205-4fd0-8b74-be3447009eae" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-6786cd1d-9205-4fd0-8b74-be3447009eae" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad2beee-048d-4fa9-9868-e9c9e33a3c9c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:57 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae Apr 29 16:50:57 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:57 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.info" returned: 0 in 0.688s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.275s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f42d6561-32b4-41d6-b828-075a245b96bb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Create snapshot completed successfully Apr 29 16:50:58 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae" returned: 0 in 0.725s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:58 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae Apr 29 16:50:58 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Acquiring lock "cinder-a36b05a9-8b57-4b35-b5ed-82236514e9bd-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-a36b05a9-8b57-4b35-b5ed-82236514e9bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Acquiring lock "cinder-quobyte-f5bffe5a-279c-4149-9559-0892d12419bd" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-quobyte-f5bffe5a-279c-4149-9559-0892d12419bd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Acquiring lock "cinder-quobyte-a36b05a9-8b57-4b35-b5ed-82236514e9bd" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-quobyte-a36b05a9-8b57-4b35-b5ed-82236514e9bd" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Deleting offline snapshot a36b05a9-8b57-4b35-b5ed-82236514e9bd of volume f5bffe5a-279c-4149-9559-0892d12419bd {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] snapshot_file for this snap is: volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9e64c8-dc4a-4b72-8020-947e9d0dc973]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:59 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd Apr 29 16:50:59 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:59 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6786cd1d-9205-4fd0-8b74-be3447009eae" returned: 0 in 0.730s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-quobyte-6786cd1d-9205-4fd0-8b74-be3447009eae" released by "delete_volume" :: held 1.521s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Created reservations ['e8425fc8-63d9-4f1e-a39f-ad11d7284779', 'aa4879f7-377c-4d77-8d2e-7a3448e3701e', '0fe0a6ea-327a-4842-b135-04c67a5639fe', '01f1b5e5-1055-4704-9600-61703dd8cfd4'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:59 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:50:59 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:59 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd" returned: 0 in 0.821s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5bffe5a-279c-4149-9559-0892d12419bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc918a6-2f3d-4183-b4db-a3c7950ad635]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:50:59 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.663s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:50:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Deleted volume successfully. Apr 29 16:50:59 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd Apr 29 16:50:59 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:50:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10c12338-fa1f-4777-839e-b7f06a9c627e tempest-VolumeDependencyTests-1838412196 None] Lock "cinder-6786cd1d-9205-4fd0-8b74-be3447009eae-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:00 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd" returned: 0 in 0.838s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:00 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd Apr 29 16:51:00 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:01 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd" returned: 0 in 0.769s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:01 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd Apr 29 16:51:01 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:02 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd.a36b05a9-8b57-4b35-b5ed-82236514e9bd" returned: 0 in 0.627s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-quobyte-a36b05a9-8b57-4b35-b5ed-82236514e9bd" released by "_delete_snapshot" :: held 3.210s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-quobyte-f5bffe5a-279c-4149-9559-0892d12419bd" released by "delete_snapshot" :: held 3.257s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Created reservations ['be431075-104c-4e93-9218-571869b6cbf1', 'bfd4e3da-b4e1-47f8-b212-2c0cd50e10bb', 'afbc07fb-ce72-40ec-b4a6-91a9a119d47b', '3a593012-e8ec-45da-89f6-4d8f23e4ef5c'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:51:02 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Delete snapshot completed successfully. Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0bf618e1-99f5-4167-ad8d-7cd76aa1bfa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-a36b05a9-8b57-4b35-b5ed-82236514e9bd-delete_snapshot" released by "delete_snapshot" :: held 3.407s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Flow 'volume_create_manager' (4b4068d0-f69a-4f7a-83f8-e991e2c67569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8177fe25-8704-4598-9ff4-72f01c7d8593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8177fe25-8704-4598-9ff4-72f01c7d8593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-834856541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96de410c-8df1-4d8f-9354-34072b1c61bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c933a4a89f4bdb9e8585cf0d3ee08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:51:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:51:03Z,use_quota=True,user_id='27d6ad664065457e98ea5880d82e8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a295a41d-7943-4b2d-a170-98df578b5cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a295a41d-7943-4b2d-a170-98df578b5cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffefc60-82c6-4ab6-9161-ae137409dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffefc60-82c6-4ab6-9161-ae137409dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96de410c-8df1-4d8f-9354-34072b1c61bc', 'volume_name': 'volume-96de410c-8df1-4d8f-9354-34072b1c61bc', 'volume_size': 2}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7800f3d5-3967-4676-b469-3861e5495407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7800f3d5-3967-4676-b469-3861e5495407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a81c337-2bcc-4e46-82d4-ad2aeb4e59ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:02 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Volume 96de410c-8df1-4d8f-9354-34072b1c61bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96de410c-8df1-4d8f-9354-34072b1c61bc', 'volume_size': 2} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-834856541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96de410c-8df1-4d8f-9354-34072b1c61bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c933a4a89f4bdb9e8585cf0d3ee08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:51:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:51:03Z,use_quota=True,user_id='27d6ad664065457e98ea5880d82e8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Creating volume 96de410c-8df1-4d8f-9354-34072b1c61bc {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:51:02 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:51:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc 2147483648 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:02 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc 2147483648 Apr 29 16:51:02 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Acquiring lock "cinder-f5bffe5a-279c-4149-9559-0892d12419bd-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-f5bffe5a-279c-4149-9559-0892d12419bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Acquiring lock "cinder-quobyte-f5bffe5a-279c-4149-9559-0892d12419bd" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-quobyte-f5bffe5a-279c-4149-9559-0892d12419bd" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b71bb8-9b25-466d-a52d-44599273151f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:03 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd Apr 29 16:51:03 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:03 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc 2147483648" returned: 0 in 0.838s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:03 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc Apr 29 16:51:03 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:03 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd" returned: 0 in 0.712s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:03 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd Apr 29 16:51:03 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:04 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc" returned: 0 in 0.630s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a81c337-2bcc-4e46-82d4-ad2aeb4e59ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96de410c-8df1-4d8f-9354-34072b1c61bc', 'volume_size': 2}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa70f61f-fe2e-4081-837f-f374c3a68a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:04 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Volume volume-96de410c-8df1-4d8f-9354-34072b1c61bc (96de410c-8df1-4d8f-9354-34072b1c61bc): created successfully Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa70f61f-fe2e-4081-837f-f374c3a68a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Flow 'volume_create_manager' (4b4068d0-f69a-4f7a-83f8-e991e2c67569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:51:04 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6507345f-3185-474b-ad95-2c1b4c5ed949 tempest-VolumesCloneNegativeTest-10635585 None] Created volume successfully. Apr 29 16:51:04 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f5bffe5a-279c-4149-9559-0892d12419bd" returned: 0 in 0.609s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-quobyte-f5bffe5a-279c-4149-9559-0892d12419bd" released by "delete_volume" :: held 1.391s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Created reservations ['8deea8d7-213d-4c18-9f72-e5f235c5f46c', '31835d98-2592-401d-897a-23c8ef4aca5e', '1b7263d4-d922-43ee-b6d1-94903651b8a1', '95f864fd-567e-4fdb-a6a3-c6b050953ea8'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:04 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:51:04 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:04 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:51:04 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Acquiring lock "cinder-96de410c-8df1-4d8f-9354-34072b1c61bc-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Lock "cinder-96de410c-8df1-4d8f-9354-34072b1c61bc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Acquiring lock "cinder-quobyte-96de410c-8df1-4d8f-9354-34072b1c61bc" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Lock "cinder-quobyte-96de410c-8df1-4d8f-9354-34072b1c61bc" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[460bfc2f-cd43-4d91-a335-2005432d305f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:05 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.626s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:51:05 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Deleted volume successfully. Apr 29 16:51:05 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc Apr 29 16:51:05 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72bc59be-b836-4581-a786-561d4e61afdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2141741836 None] Lock "cinder-f5bffe5a-279c-4149-9559-0892d12419bd-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:05 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.651s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:51:05 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc" returned: 0 in 0.744s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:05 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc Apr 29 16:51:05 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:06 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-96de410c-8df1-4d8f-9354-34072b1c61bc" returned: 0 in 0.627s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Lock "cinder-quobyte-96de410c-8df1-4d8f-9354-34072b1c61bc" released by "delete_volume" :: held 1.426s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:06 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Created reservations ['207fb7a2-5d92-49c2-82ee-b27d6009f693', '1702bd64-60b3-4697-9a7b-1bed7feaf137', '61580f5f-5735-4bb7-8d3a-78b59a8ed83e', 'c682c51a-7ae1-4400-bdd7-6f13b35a22b6'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:51:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:06 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:51:06 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:07 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.679s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:07 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:51:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Deleted volume successfully. Apr 29 16:51:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-dbd64c91-cc6b-41fd-9540-03299f8b3213 tempest-VolumesCloneNegativeTest-10635585 None] Lock "cinder-96de410c-8df1-4d8f-9354-34072b1c61bc-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:10 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:51:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Flow 'volume_create_manager' (d2e7d1c4-0611-4a41-8f7b-807c31d58f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:51:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96cfec8-041b-4709-86b4-ee69f3f9a276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96cfec8-041b-4709-86b4-ee69f3f9a276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1782894498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f87d803-77e7-4069-963c-6f193cae29c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e819a8e977fc4399a9c33fa34447aefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:51:11Z,use_quota=True,user_id='6465704c86ec435d81896c737786aca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3d62c0-9141-4d9e-869e-97fb0d294f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3d62c0-9141-4d9e-869e-97fb0d294f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90333789-3b6e-47d2-b706-93e1d8fbf677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:10 devstack cinder-volume[84201]: DEBUG cinder.image.glance [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Creating Keystone auth plugin from conf {{(pid=84201) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 16:51:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90333789-3b6e-47d2-b706-93e1d8fbf677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f87d803-77e7-4069-963c-6f193cae29c5', 'volume_name': 'volume-3f87d803-77e7-4069-963c-6f193cae29c5', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72f20bf-c487-49cf-b60d-72cfa82c0f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72f20bf-c487-49cf-b60d-72cfa82c0f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20c450a-daea-4f45-912a-c666657c62b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:11 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Volume 3f87d803-77e7-4069-963c-6f193cae29c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f87d803-77e7-4069-963c-6f193cae29c5', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 16:51:11 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Trying to clone 3f87d803-77e7-4069-963c-6f193cae29c5 from image 41e2d651-26b7-481d-97f0-de8b038b5cd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]). {{(pid=84201) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 16:51:11 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 16:51:11 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Image download 20.69 MB at 20.69 MB/s Apr 29 16:51:11 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd28ad9-5232-4ed5-aff7-5147957d0a3b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:12 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD Apr 29 16:51:12 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:12 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD" returned: 0 in 0.718s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:12 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Temporary image 41e2d651-26b7-481d-97f0-de8b038b5cd4 is fetched for user 6465704c86ec435d81896c737786aca1. {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 16:51:12 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dc6185-13ad-4613-9f78-7348b70dcd87]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:12 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD Apr 29 16:51:12 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:13 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1782894498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f87d803-77e7-4069-963c-6f193cae29c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e819a8e977fc4399a9c33fa34447aefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:51:11Z,use_quota=True,user_id='6465704c86ec435d81896c737786aca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Creating volume 3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:51:13 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:51:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:13 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 1073741824 Apr 29 16:51:13 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:14 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 1073741824" returned: 0 in 0.837s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:14 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 Apr 29 16:51:14 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:14 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5" returned: 0 in 0.636s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:51:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:14 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Attempting download of 41e2d651-26b7-481d-97f0-de8b038b5cd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}])) to volume 3f87d803-77e7-4069-963c-6f193cae29c5. {{(pid=84201) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 16:51:15 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0882f9-519f-48eb-aa41-25c15dded421]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_j0t1wjcf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:15 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_j0t1wjcf Apr 29 16:51:15 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:15 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_j0t1wjcf" returned: 0 in 0.685s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_j0t1wjcf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:15 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_j0t1wjcf Apr 29 16:51:15 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:16 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_j0t1wjcf" returned: 1 in 0.760s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41e2d651-26b7-481d-97f0-de8b038b5cd4_j0t1wjcf' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:51:16 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff342dfa-2235-417b-8ed3-e8b5557e6d54]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:16 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD Apr 29 16:51:16 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:17 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:17 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] 41e2d651-26b7-481d-97f0-de8b038b5cd4 was qcow2, converting to raw {{(pid=84201) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 16:51:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:17 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 Apr 29 16:51:17 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:19 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5" returned: 0 in 2.041s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:19 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_41e2d651-26b7-481d-97f0-de8b038b5cd4_9bg3kazedevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:51:19 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Converted 112.00 MB image at 54.84 MB/s Apr 29 16:51:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:19 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 1G Apr 29 16:51:19 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:19 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 1G" returned: 0 in 0.717s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:19 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5458a6d-c1de-45f6-adf1-baaeb48b81c5]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:20 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 Apr 29 16:51:20 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:20 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5" returned: 0 in 0.744s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:20 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 Apr 29 16:51:20 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:21 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5" returned: 1 in 0.713s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Downloaded image 41e2d651-26b7-481d-97f0-de8b038b5cd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}])) to volume 3f87d803-77e7-4069-963c-6f193cae29c5 successfully. {{(pid=84201) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Temporary image 41e2d651-26b7-481d-97f0-de8b038b5cd4 for user 6465704c86ec435d81896c737786aca1 is deleted. {{(pid=84201) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG cinder.volume.volume_utils [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Marking volume 3f87d803-77e7-4069-963c-6f193cae29c5 as bootable. {{(pid=84201) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Copying metadata from image 41e2d651-26b7-481d-97f0-de8b038b5cd4 to 3f87d803-77e7-4069-963c-6f193cae29c5. {{(pid=84201) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Creating volume glance metadata for volume 3f87d803-77e7-4069-963c-6f193cae29c5 backed by image 41e2d651-26b7-481d-97f0-de8b038b5cd4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84201) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20c450a-daea-4f45-912a-c666657c62b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f87d803-77e7-4069-963c-6f193cae29c5', 'volume_size': 1, 'image_id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41e2d651-26b7-481d-97f0-de8b038b5cd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58272c7173f348e4896b60454c255725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '41e2d651-26b7-481d-97f0-de8b038b5cd4', 'created_at': datetime.datetime(2026, 4, 29, 14, 38, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 38, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41e2d651-26b7-481d-97f0-de8b038b5cd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0773d899-e951-4f6a-9102-24383580d66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:21 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Volume volume-3f87d803-77e7-4069-963c-6f193cae29c5 (3f87d803-77e7-4069-963c-6f193cae29c5): created successfully Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0773d899-e951-4f6a-9102-24383580d66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Flow 'volume_create_manager' (d2e7d1c4-0611-4a41-8f7b-807c31d58f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:51:21 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-17ea6632-685e-4d52-9d82-0517127133db tempest-VolumesExtendTest-1440673693 None] Created volume successfully. Apr 29 16:51:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:22 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aa007a-44b4-4679-ba65-91312805bd12]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:22 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 Apr 29 16:51:22 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:23 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5" returned: 0 in 0.707s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:23 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 Apr 29 16:51:23 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:24 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5" returned: 1 in 0.750s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:51:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 2G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 2G" returned: 0 in 0.066s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.574s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:24 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-26687cc0-3276-4aa7-b305-0565c496265e tempest-VolumesExtendTest-1440673693 None] Extend volume completed successfully. Apr 29 16:51:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Acquiring lock "cinder-3f87d803-77e7-4069-963c-6f193cae29c5-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Lock "cinder-3f87d803-77e7-4069-963c-6f193cae29c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Acquiring lock "cinder-quobyte-3f87d803-77e7-4069-963c-6f193cae29c5" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Lock "cinder-quobyte-3f87d803-77e7-4069-963c-6f193cae29c5" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:25 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b758ac-50c0-4695-acc4-532593a80297]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:25 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 Apr 29 16:51:25 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:25 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5" returned: 0 in 0.700s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:25 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 Apr 29 16:51:25 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:26 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5" returned: 1 in 0.701s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:51:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:26 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5 Apr 29 16:51:26 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:27 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3f87d803-77e7-4069-963c-6f193cae29c5" returned: 0 in 0.608s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Lock "cinder-quobyte-3f87d803-77e7-4069-963c-6f193cae29c5" released by "delete_volume" :: held 2.083s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:DELETE=12,cinder:INSERT=34,cinder:UPDATE=121,cinder:SELECT=80 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Created reservations ['86c68b30-47b9-4e53-b261-6c4139126f93', '2177c867-3ffa-4cce-8850-7ed60a243bcf', 'bfb55cfb-aefe-4c9d-80ad-ecb97ad72dee', 'ade8b8c7-1d18-424e-a1fd-d1b931250b55'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:27 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:51:27 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:27 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.641s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:51:27 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Deleted volume successfully. Apr 29 16:51:27 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-9fa2fdf1-4491-4007-8fdf-cc9ffa365b2d tempest-VolumesExtendTest-1440673693 None] Lock "cinder-3f87d803-77e7-4069-963c-6f193cae29c5-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Flow 'volume_create_manager' (3e68c2d2-b43a-47a9-bdc3-ccca046623a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acad1eea-0964-464b-9a7b-c4ce0fa174b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acad1eea-0964-464b-9a7b-c4ce0fa174b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1391707019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b186f25-4222-44c6-9c42-6e528a208ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e819a8e977fc4399a9c33fa34447aefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:51:29Z,use_quota=True,user_id='6465704c86ec435d81896c737786aca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22173014-02c1-4c37-be8d-30000d816a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22173014-02c1-4c37-be8d-30000d816a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52639bca-8ff0-45ea-a88d-7592846899ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52639bca-8ff0-45ea-a88d-7592846899ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b186f25-4222-44c6-9c42-6e528a208ae0', 'volume_name': 'volume-2b186f25-4222-44c6-9c42-6e528a208ae0', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7215b4d-ee58-4599-a85d-ae2363769462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7215b4d-ee58-4599-a85d-ae2363769462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cd2c0f-56b0-4ea2-a6cf-215e444e10fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:28 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Volume 2b186f25-4222-44c6-9c42-6e528a208ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b186f25-4222-44c6-9c42-6e528a208ae0', 'volume_size': 1} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1391707019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b186f25-4222-44c6-9c42-6e528a208ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e819a8e977fc4399a9c33fa34447aefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:51:29Z,use_quota=True,user_id='6465704c86ec435d81896c737786aca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Creating volume 2b186f25-4222-44c6-9c42-6e528a208ae0 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:51:28 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:51:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:28 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 1073741824 Apr 29 16:51:28 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:29 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 1073741824" returned: 0 in 0.817s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:29 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 Apr 29 16:51:29 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:30 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0" returned: 0 in 0.607s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:51:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cd2c0f-56b0-4ea2-a6cf-215e444e10fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b186f25-4222-44c6-9c42-6e528a208ae0', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48353e0a-8939-4e7a-8665-7de12d963998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:30 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Volume volume-2b186f25-4222-44c6-9c42-6e528a208ae0 (2b186f25-4222-44c6-9c42-6e528a208ae0): created successfully Apr 29 16:51:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48353e0a-8939-4e7a-8665-7de12d963998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Flow 'volume_create_manager' (3e68c2d2-b43a-47a9-bdc3-ccca046623a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:51:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-72ce5aa4-a17a-4f93-9877-4640a1199713 tempest-VolumesExtendTest-1440673693 None] Created volume successfully. Apr 29 16:51:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Creating offline snapshot c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 of volume 2b186f25-4222-44c6-9c42-6e528a208ae0 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:51:31 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e04465-7e87-41b3-9094-52cb1b5151e3]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:31 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 Apr 29 16:51:31 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:31 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0" returned: 0 in 0.726s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:31 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 1G Apr 29 16:51:31 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:32 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 1G" returned: 0 in 0.820s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b186f25-4222-44c6-9c42-6e528a208ae0 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:32 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b186f25-4222-44c6-9c42-6e528a208ae0 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 Apr 29 16:51:32 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:33 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b186f25-4222-44c6-9c42-6e528a208ae0 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7" returned: 0 in 0.724s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:33 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 is being set with open permissions: ugo+rw Apr 29 16:51:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:33 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 Apr 29 16:51:33 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:33 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7" returned: 0 in 0.667s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:34 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.info Apr 29 16:51:34 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:34 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.info" returned: 0 in 0.625s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:34 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.info is being set with open permissions: ugo+rw Apr 29 16:51:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:34 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.info Apr 29 16:51:34 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:35 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.info" returned: 0 in 0.608s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.264s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-3b9bc941-3090-493c-81f5-9014fbda0813 tempest-VolumesExtendTest-1440673693 None] Create snapshot completed successfully Apr 29 16:51:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6648d6f9-8f94-43aa-b210-890ca957d401 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6648d6f9-8f94-43aa-b210-890ca957d401 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:36 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f4818f-ab73-4922-b411-5872430b19d7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6648d6f9-8f94-43aa-b210-890ca957d401 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:36 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 Apr 29 16:51:36 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:37 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6648d6f9-8f94-43aa-b210-890ca957d401 tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0" returned: 0 in 0.745s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6648d6f9-8f94-43aa-b210-890ca957d401 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 2G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6648d6f9-8f94-43aa-b210-890ca957d401 tempest-VolumesExtendTest-1440673693 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 2G" returned: 0 in 0.129s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6648d6f9-8f94-43aa-b210-890ca957d401 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.906s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:37 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6648d6f9-8f94-43aa-b210-890ca957d401 tempest-VolumesExtendTest-1440673693 None] Extend volume completed successfully. Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "cinder-c18169c1-3fb7-4aff-a4cf-788eeef0f2d7-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-c18169c1-3fb7-4aff-a4cf-788eeef0f2d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "cinder-quobyte-2b186f25-4222-44c6-9c42-6e528a208ae0" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-quobyte-2b186f25-4222-44c6-9c42-6e528a208ae0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "cinder-quobyte-c18169c1-3fb7-4aff-a4cf-788eeef0f2d7" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-quobyte-c18169c1-3fb7-4aff-a4cf-788eeef0f2d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Deleting offline snapshot c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 of volume 2b186f25-4222-44c6-9c42-6e528a208ae0 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] snapshot_file for this snap is: volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[88239791-675a-4cc5-9f67-7970e6d3992a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:37 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 Apr 29 16:51:37 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:38 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7" returned: 0 in 0.707s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b186f25-4222-44c6-9c42-6e528a208ae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:51:38 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb869f8e-d8c0-49e3-8315-6d856c63b429]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:38 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 Apr 29 16:51:38 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:39 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0" returned: 0 in 0.713s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:39 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 Apr 29 16:51:39 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:39 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7" returned: 0 in 0.824s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:39 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7 Apr 29 16:51:39 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:40 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0.c18169c1-3fb7-4aff-a4cf-788eeef0f2d7" returned: 0 in 0.633s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-quobyte-c18169c1-3fb7-4aff-a4cf-788eeef0f2d7" released by "_delete_snapshot" :: held 2.986s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-quobyte-2b186f25-4222-44c6-9c42-6e528a208ae0" released by "delete_snapshot" :: held 3.008s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:40 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Created reservations ['b96258e0-d686-4d07-8433-42d39fe6c2e9', 'e57caba1-40c7-484b-9ae2-e75336e3822e', '8a1c7862-4638-4075-bf38-6ef5a15aacfb', '12823b0a-7538-4012-8d9c-9cd6d37aaf54'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:51:40 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Delete snapshot completed successfully. Apr 29 16:51:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d099ab23-5a5c-4cf5-8ce8-aecefde5d8d1 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-c18169c1-3fb7-4aff-a4cf-788eeef0f2d7-delete_snapshot" released by "delete_snapshot" :: held 3.164s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "cinder-2b186f25-4222-44c6-9c42-6e528a208ae0-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-2b186f25-4222-44c6-9c42-6e528a208ae0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "cinder-quobyte-2b186f25-4222-44c6-9c42-6e528a208ae0" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-quobyte-2b186f25-4222-44c6-9c42-6e528a208ae0" acquired by "delete_volume" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:41 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc33546-6e6b-4d9f-9b1a-91be10f1b448]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:42 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 Apr 29 16:51:42 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:42 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0" returned: 0 in 0.687s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:42 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0 Apr 29 16:51:42 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:43 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-2b186f25-4222-44c6-9c42-6e528a208ae0" returned: 0 in 0.610s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-quobyte-2b186f25-4222-44c6-9c42-6e528a208ae0" released by "delete_volume" :: held 1.357s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Created reservations ['91e4dfb2-dfaf-4ce1-b422-f71fcdd4f31c', '85d65aa5-dff8-43a7-81cc-509cc1a9af1b', '6a29f8c3-7922-47ff-9aa2-0ad935ccb36d', 'e6b22f06-2e5a-40a1-a802-87de29a928da'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:43 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:51:43 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:43 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.596s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:51:43 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Deleted volume successfully. Apr 29 16:51:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e449707f-7d30-44e5-945b-7cbf7c286d75 tempest-VolumesExtendTest-1440673693 None] Lock "cinder-2b186f25-4222-44c6-9c42-6e528a208ae0-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (3909fff3-9bc5-45e3-a2af-64d5fcd6012a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0daa95-fa76-42a0-9aca-0c2ba109aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0daa95-fa76-42a0-9aca-0c2ba109aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-110887477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:51:50Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802b885b-2bcc-4cfa-ad8c-b602cc5279c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802b885b-2bcc-4cfa-ad8c-b602cc5279c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00e9fb4-8ced-4312-b8f4-4877bae42750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00e9fb4-8ced-4312-b8f4-4877bae42750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1', 'volume_name': 'volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a02e6f4-35ec-4e6d-b074-3cfe5251d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a02e6f4-35ec-4e6d-b074-3cfe5251d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eff98f6-0527-4ad2-a322-62e2ad60d86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:50 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Volume f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1', 'volume_size': 1} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-110887477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:51:50Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Creating volume f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:51:50 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:51:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:50 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 1073741824 Apr 29 16:51:50 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:51 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 1073741824" returned: 0 in 0.896s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=80,cinder:INSERT=30,cinder:UPDATE=102,cinder:DELETE=4 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:51 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 Apr 29 16:51:51 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:51 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1" returned: 0 in 0.658s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eff98f6-0527-4ad2-a322-62e2ad60d86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c4853d-4349-43fe-82fb-3e08d2458f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:51:51 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Volume volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 (f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1): created successfully Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c4853d-4349-43fe-82fb-3e08d2458f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:51:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (3909fff3-9bc5-45e3-a2af-64d5fcd6012a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:51:51 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-9497b5d4-485c-48bc-a243-16006447d298 tempest-VolumesActionsTest-1369079519 None] Created volume successfully. Apr 29 16:51:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-195deb4b-0ac3-4307-a085-def468157c80 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1" by "attach_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-195deb4b-0ac3-4307-a085-def468157c80 tempest-VolumesActionsTest-1369079519 None] Lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1" acquired by "attach_volume" :: waited 0.031s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-195deb4b-0ac3-4307-a085-def468157c80 tempest-VolumesActionsTest-1369079519 None] Attaching volume f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 to instance 1a6d6e7f-89ac-4997-a626-f5a3f56329dc at mountpoint /dev/vdb on host None. Apr 29 16:51:52 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-195deb4b-0ac3-4307-a085-def468157c80 tempest-VolumesActionsTest-1369079519 None] Attach volume completed successfully. Apr 29 16:51:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-195deb4b-0ac3-4307-a085-def468157c80 tempest-VolumesActionsTest-1369079519 None] Lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1" released by "attach_volume" :: held 0.109s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:53 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-68566ce7-046c-41e3-b2f7-adbc66048331 tempest-VolumesActionsTest-986967491 None] Terminate volume connection completed successfully. Apr 29 16:51:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-68566ce7-046c-41e3-b2f7-adbc66048331 tempest-VolumesActionsTest-986967491 None] Acquiring lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1-detach_volume" by "detach_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-68566ce7-046c-41e3-b2f7-adbc66048331 tempest-VolumesActionsTest-986967491 None] Lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:53 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-68566ce7-046c-41e3-b2f7-adbc66048331 tempest-VolumesActionsTest-986967491 None] Detaching volume f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 from instance 1a6d6e7f-89ac-4997-a626-f5a3f56329dc. Apr 29 16:51:53 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-68566ce7-046c-41e3-b2f7-adbc66048331 tempest-VolumesActionsTest-986967491 None] Detach volume completed successfully. Apr 29 16:51:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-68566ce7-046c-41e3-b2f7-adbc66048331 tempest-VolumesActionsTest-986967491 None] Lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1-detach_volume" released by "detach_volume" :: held 0.152s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-69649058-6d1c-470e-8bf5-c47b3d282f85 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1-detach_volume" by "detach_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-69649058-6d1c-470e-8bf5-c47b3d282f85 tempest-VolumesActionsTest-1369079519 None] Lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:54 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-69649058-6d1c-470e-8bf5-c47b3d282f85 tempest-VolumesActionsTest-1369079519 None] Volume detach called, but volume not attached. Apr 29 16:51:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-69649058-6d1c-470e-8bf5-c47b3d282f85 tempest-VolumesActionsTest-1369079519 None] Lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "cinder-quobyte-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:51:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Lock "cinder-quobyte-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:51:55 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7262e0be-a1ce-4d59-a17f-2f9926f8b64d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:51:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:55 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 Apr 29 16:51:55 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:56 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1" returned: 0 in 0.792s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:56 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1 Apr 29 16:51:56 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:56 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1" returned: 0 in 0.641s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Lock "cinder-quobyte-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1" released by "delete_volume" :: held 1.493s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Created reservations ['104c2768-a067-41af-8c3f-a5e656cb9214', 'c17fd6a9-623d-437c-b707-0fbb8033c7a7', 'eed1cd6a-3d6b-4c84-8574-bec9a2031d29', '676f08a7-c700-4137-904c-7d5847a84093'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:51:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:51:57 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:51:57 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:51:57 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Apr 29 16:51:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.751s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:51:57 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:51:57 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Deleted volume successfully. Apr 29 16:51:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1fe25937-83eb-4925-8979-e6a26fa0ad39 tempest-VolumesActionsTest-1369079519 None] Lock "cinder-f69916c7-1cae-4d3d-8eb7-0c2e4dd333a1-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (a2d00017-724b-4f57-a724-58016108282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f4ec2f-f1eb-4a5a-a12b-5dfbcec483c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f4ec2f-f1eb-4a5a-a12b-5dfbcec483c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-498494586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c84056-7e12-4d03-92b2-c427a60fc881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5077b7e44f4ca087a314f5fa4adf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:01Z,use_quota=True,user_id='d0687718d0ea477297a1c437cfd2b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce992432-280d-407c-9342-36014582be7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce992432-280d-407c-9342-36014582be7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257e1a56-25d7-4ef3-b97b-13c35a0e11c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257e1a56-25d7-4ef3-b97b-13c35a0e11c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c84056-7e12-4d03-92b2-c427a60fc881', 'volume_name': 'volume-61c84056-7e12-4d03-92b2-c427a60fc881', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56aae345-d820-415e-8949-456e4d093018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56aae345-d820-415e-8949-456e4d093018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7e5822-4e42-46e0-b05a-b030d4b96a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:01 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Volume 61c84056-7e12-4d03-92b2-c427a60fc881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c84056-7e12-4d03-92b2-c427a60fc881', 'volume_size': 1} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-498494586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c84056-7e12-4d03-92b2-c427a60fc881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5077b7e44f4ca087a314f5fa4adf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:01Z,use_quota=True,user_id='d0687718d0ea477297a1c437cfd2b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Creating volume 61c84056-7e12-4d03-92b2-c427a60fc881 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:01 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:52:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:01 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 1073741824 Apr 29 16:52:01 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:01 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 1073741824" returned: 0 in 0.770s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:02 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 Apr 29 16:52:02 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:02 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881" returned: 0 in 0.611s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:52:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7e5822-4e42-46e0-b05a-b030d4b96a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c84056-7e12-4d03-92b2-c427a60fc881', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935047d0-967e-4cc2-b1ac-0677ac615668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:02 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Volume volume-61c84056-7e12-4d03-92b2-c427a60fc881 (61c84056-7e12-4d03-92b2-c427a60fc881): created successfully Apr 29 16:52:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935047d0-967e-4cc2-b1ac-0677ac615668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (a2d00017-724b-4f57-a724-58016108282b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:02 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-254b3c84-bf2b-47ff-a782-444ab0b6f273 tempest-VolumesSnapshotTestJSON-2126495909 None] Created volume successfully. Apr 29 16:52:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Creating offline snapshot 68c51e36-720c-4678-9935-8bfc66062a0f of volume 61c84056-7e12-4d03-92b2-c427a60fc881 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:52:03 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f04a20e-3501-4d85-831e-1455899c93e9]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:03 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 Apr 29 16:52:03 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:04 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881" returned: 0 in 0.706s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:04 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f 1G Apr 29 16:52:04 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:52:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:04 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:52:04 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:05 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f 1G" returned: 0 in 0.775s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c84056-7e12-4d03-92b2-c427a60fc881 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:05 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c84056-7e12-4d03-92b2-c427a60fc881 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f Apr 29 16:52:05 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:05 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.680s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (fa7863da-2ff8-4e04-be65-dfa95c5e1120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a5a5f8-239a-4eab-8f80-c97eb94cad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a5a5f8-239a-4eab-8f80-c97eb94cad4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-415717692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d38b231-b95a-465f-8695-7ad4d36f0590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:06Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aeb11e9-9e2f-47a3-863b-d5d7a7ac7059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aeb11e9-9e2f-47a3-863b-d5d7a7ac7059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec03a1a-ed81-408b-afa4-64f08fd378ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec03a1a-ed81-408b-afa4-64f08fd378ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d38b231-b95a-465f-8695-7ad4d36f0590', 'volume_name': 'volume-5d38b231-b95a-465f-8695-7ad4d36f0590', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df16e8d-9f42-42c8-b43c-e9aec213dcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df16e8d-9f42-42c8-b43c-e9aec213dcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb5d19-674d-40a2-aac9-8e6f141b0229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:05 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Volume 5d38b231-b95a-465f-8695-7ad4d36f0590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d38b231-b95a-465f-8695-7ad4d36f0590', 'volume_size': 1} Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:05 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c84056-7e12-4d03-92b2-c427a60fc881 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f" returned: 0 in 0.730s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:05 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f is being set with open permissions: ugo+rw Apr 29 16:52:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:05 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f Apr 29 16:52:05 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:06 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f" returned: 0 in 0.624s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:06 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.info Apr 29 16:52:06 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:07 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.info" returned: 0 in 0.598s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:07 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.info is being set with open permissions: ugo+rw Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:07 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.info Apr 29 16:52:07 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:07 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.info" returned: 0 in 0.593s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.109s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.997s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-415717692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d38b231-b95a-465f-8695-7ad4d36f0590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:06Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Creating volume 5d38b231-b95a-465f-8695-7ad4d36f0590 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:07 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:52:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:07 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590 1073741824 Apr 29 16:52:07 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-81cf9817-26e2-4165-a9f1-75815006b24c tempest-VolumesSnapshotTestJSON-2126495909 None] Create snapshot completed successfully Apr 29 16:52:08 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590 1073741824" returned: 0 in 0.802s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:08 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590 Apr 29 16:52:08 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-68c51e36-720c-4678-9935-8bfc66062a0f-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-68c51e36-720c-4678-9935-8bfc66062a0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-61c84056-7e12-4d03-92b2-c427a60fc881" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-61c84056-7e12-4d03-92b2-c427a60fc881" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-68c51e36-720c-4678-9935-8bfc66062a0f" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-68c51e36-720c-4678-9935-8bfc66062a0f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Deleting offline snapshot 68c51e36-720c-4678-9935-8bfc66062a0f of volume 61c84056-7e12-4d03-92b2-c427a60fc881 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] snapshot_file for this snap is: volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f046bb-aab8-45a7-983a-3cd83626290d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:09 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f Apr 29 16:52:09 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:09 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590" returned: 0 in 0.602s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb5d19-674d-40a2-aac9-8e6f141b0229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d38b231-b95a-465f-8695-7ad4d36f0590', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf67022a-f03f-45af-a871-f83f2ac45569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:09 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Volume volume-5d38b231-b95a-465f-8695-7ad4d36f0590 (5d38b231-b95a-465f-8695-7ad4d36f0590): created successfully Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf67022a-f03f-45af-a871-f83f2ac45569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (fa7863da-2ff8-4e04-be65-dfa95c5e1120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:09 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-223fddec-8087-4252-ac0d-61c296025182 tempest-VolumesActionsTest-1369079519 None] Created volume successfully. Apr 29 16:52:09 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f" returned: 0 in 0.744s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c84056-7e12-4d03-92b2-c427a60fc881(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afad35c-c6fb-4b97-a21f-8309f3f1531e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:09 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 Apr 29 16:52:09 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Acquiring lock "cinder-5d38b231-b95a-465f-8695-7ad4d36f0590-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Lock "cinder-5d38b231-b95a-465f-8695-7ad4d36f0590-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Acquiring lock "cinder-quobyte-5d38b231-b95a-465f-8695-7ad4d36f0590" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Lock "cinder-quobyte-5d38b231-b95a-465f-8695-7ad4d36f0590" acquired by "delete_volume" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e89b1eb-029f-4511-8d13-c4dec8b5ecaf]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:10 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590 Apr 29 16:52:10 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:10 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881" returned: 0 in 0.732s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:10 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f Apr 29 16:52:10 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:10 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590" returned: 0 in 0.707s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:10 devstack sudo[91517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590 Apr 29 16:52:10 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:11 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f" returned: 0 in 0.699s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:11 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f Apr 29 16:52:11 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:11 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5d38b231-b95a-465f-8695-7ad4d36f0590" returned: 0 in 0.632s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Lock "cinder-quobyte-5d38b231-b95a-465f-8695-7ad4d36f0590" released by "delete_volume" :: held 1.397s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Created reservations ['7976af35-f475-4218-8d7c-c92f78da4229', 'eca139e8-f036-4818-8b0c-a48c65b90c9b', 'd89ec69c-d0d5-406d-aaec-ba8563fc009b', '461a6d74-38e8-4f7f-b15d-1fe0aebbf989'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:11 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:52:11 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:11 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881.68c51e36-720c-4678-9935-8bfc66062a0f" returned: 0 in 0.586s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-68c51e36-720c-4678-9935-8bfc66062a0f" released by "_delete_snapshot" :: held 2.864s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-61c84056-7e12-4d03-92b2-c427a60fc881" released by "delete_snapshot" :: held 2.884s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Created reservations ['d9d14779-cada-460d-bb47-9a97ac988009', '2be44da0-05da-48aa-b876-d90224fe39d1', 'f928fd3b-1ad4-478a-a3cb-99c9104e9866', '1226c771-4544-4fc7-8694-4fa86034b097'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Delete snapshot completed successfully. Apr 29 16:52:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-73040745-67c2-4257-af8f-3253d21e90cf tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-68c51e36-720c-4678-9935-8bfc66062a0f-delete_snapshot" released by "delete_snapshot" :: held 3.053s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:12 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.630s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:52:12 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Deleted volume successfully. Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5f706df-6e1a-46a9-90c7-a0a87082ad72 tempest-VolumesActionsTest-986967491 None] Lock "cinder-5d38b231-b95a-465f-8695-7ad4d36f0590-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (42746702-0118-46b4-bdb3-024fdf32eabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9775645d-6c58-4ede-a8a4-8d290dc923a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9775645d-6c58-4ede-a8a4-8d290dc923a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-564806650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984f098e-49c7-45ec-8a53-d8b1eadf99ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5077b7e44f4ca087a314f5fa4adf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:13Z,use_quota=True,user_id='d0687718d0ea477297a1c437cfd2b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9888a23d-a18e-49bd-82b8-6301f8a6b855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9888a23d-a18e-49bd-82b8-6301f8a6b855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179f5177-ba0e-46ae-8695-f1b9a0a294b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179f5177-ba0e-46ae-8695-f1b9a0a294b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984f098e-49c7-45ec-8a53-d8b1eadf99ed', 'volume_name': 'volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb81531-81f0-4c96-9a14-12ead8f5657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb81531-81f0-4c96-9a14-12ead8f5657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb5360a-d021-4d08-b6e2-69940258278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Volume 984f098e-49c7-45ec-8a53-d8b1eadf99ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed', 'volume_size': 1} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-564806650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984f098e-49c7-45ec-8a53-d8b1eadf99ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5077b7e44f4ca087a314f5fa4adf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:13Z,use_quota=True,user_id='d0687718d0ea477297a1c437cfd2b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Creating volume 984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:12 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:12 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed 1073741824 Apr 29 16:52:12 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (be6abc24-db59-4150-95f8-116271b76163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d337d8-0e64-4048-a3f8-c0d571084008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d337d8-0e64-4048-a3f8-c0d571084008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-912781697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3e52e5-1d08-43c0-83cf-310f9a395cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:13Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ac55ff-9f2d-4d6e-8d51-cc45c50719f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ac55ff-9f2d-4d6e-8d51-cc45c50719f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923a787e-da74-4e9d-981f-2fd94c3a6bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923a787e-da74-4e9d-981f-2fd94c3a6bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3e52e5-1d08-43c0-83cf-310f9a395cfd', 'volume_name': 'volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a848324-df90-4966-b00a-32da9968de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a848324-df90-4966-b00a-32da9968de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23589c07-c96d-4a68-a87d-5e39c9ab76ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:12 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Volume 7f3e52e5-1d08-43c0-83cf-310f9a395cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd', 'volume_size': 1} Apr 29 16:52:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:13 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed 1073741824" returned: 0 in 0.746s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:13 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed Apr 29 16:52:13 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:14 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed" returned: 0 in 0.598s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-912781697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3e52e5-1d08-43c0-83cf-310f9a395cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:13Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Creating volume 7f3e52e5-1d08-43c0-83cf-310f9a395cfd {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:14 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb5360a-d021-4d08-b6e2-69940258278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7facdcc8-c7c3-4b9e-a828-5fc23541a02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:14 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd 1073741824 Apr 29 16:52:14 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:14 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Volume volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed (984f098e-49c7-45ec-8a53-d8b1eadf99ed): created successfully Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7facdcc8-c7c3-4b9e-a828-5fc23541a02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (42746702-0118-46b4-bdb3-024fdf32eabc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:14 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-900fa59f-7cb0-4ff0-8b38-76d30b1ca9f8 tempest-VolumesSnapshotTestJSON-2126495909 None] Created volume successfully. Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:14 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd 1073741824" returned: 0 in 0.807s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:14 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd Apr 29 16:52:14 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:15 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd" returned: 0 in 0.586s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.643s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23589c07-c96d-4a68-a87d-5e39c9ab76ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0548541-452b-441f-94c9-21a25c2463df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Creating offline snapshot 1c5aa37f-59bd-45b3-ae4b-71f176bd932a of volume 984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:52:15 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Volume volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd (7f3e52e5-1d08-43c0-83cf-310f9a395cfd): created successfully Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0548541-452b-441f-94c9-21a25c2463df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (be6abc24-db59-4150-95f8-116271b76163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[70523ebb-6d3d-4114-aeee-3bc5cb8ce2b8]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-4b273718-d582-4d0b-8f4d-e089b36c7bef tempest-VolumesActionsTest-1369079519 None] Created volume successfully. Apr 29 16:52:15 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed Apr 29 16:52:15 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Acquiring lock "cinder-7f3e52e5-1d08-43c0-83cf-310f9a395cfd-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Lock "cinder-7f3e52e5-1d08-43c0-83cf-310f9a395cfd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Acquiring lock "cinder-quobyte-7f3e52e5-1d08-43c0-83cf-310f9a395cfd" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Lock "cinder-quobyte-7f3e52e5-1d08-43c0-83cf-310f9a395cfd" acquired by "delete_volume" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1032bf94-7cf3-4f11-87dd-b680ca52ea8b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:16 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd Apr 29 16:52:16 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:16 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed" returned: 0 in 0.724s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:16 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a 1G Apr 29 16:52:16 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:16 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd" returned: 0 in 0.723s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:16 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd Apr 29 16:52:16 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:17 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a 1G" returned: 0 in 0.719s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:17 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a Apr 29 16:52:17 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:17 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-7f3e52e5-1d08-43c0-83cf-310f9a395cfd" returned: 0 in 0.611s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Lock "cinder-quobyte-7f3e52e5-1d08-43c0-83cf-310f9a395cfd" released by "delete_volume" :: held 1.385s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Created reservations ['349305cf-812d-4284-adbf-415eb17126f7', 'b8d1f6a9-5081-44b0-9d77-542bb2183e86', '74114702-dfb5-4beb-bb47-1edfb499a858', 'a2658d7c-b194-4247-ab01-710d2d7a5434'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:17 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:52:17 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:17 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a" returned: 0 in 0.667s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:17 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a is being set with open permissions: ugo+rw Apr 29 16:52:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:17 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a Apr 29 16:52:17 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:18 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.582s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:52:18 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Deleted volume successfully. Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-debb4aca-8cc8-4259-bcb9-ab6760a6e7e7 tempest-VolumesActionsTest-986967491 None] Lock "cinder-7f3e52e5-1d08-43c0-83cf-310f9a395cfd-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:18 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a" returned: 0 in 0.616s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:18 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.info Apr 29 16:52:18 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (6e26df52-36d7-4fee-a667-35bea00312b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ddea8d-7be7-4c9d-bcf1-def8155e1e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ddea8d-7be7-4c9d-bcf1-def8155e1e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562835826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca21a46-c219-4872-bc72-349e6a5c9b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:19Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312f4505-719d-48c9-8b20-9a21e3a3b7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312f4505-719d-48c9-8b20-9a21e3a3b7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074e1589-aeeb-4813-9d54-39fecf830b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074e1589-aeeb-4813-9d54-39fecf830b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca21a46-c219-4872-bc72-349e6a5c9b64', 'volume_name': 'volume-6ca21a46-c219-4872-bc72-349e6a5c9b64', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6557c00f-8759-4208-9c92-55d14cc1b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6557c00f-8759-4208-9c92-55d14cc1b34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0bdefa-04e2-44ad-bf95-4c28a82bb3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:18 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Volume 6ca21a46-c219-4872-bc72-349e6a5c9b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca21a46-c219-4872-bc72-349e6a5c9b64', 'volume_size': 1} Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:18 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.info" returned: 0 in 0.617s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:18 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.info is being set with open permissions: ugo+rw Apr 29 16:52:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:18 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.info Apr 29 16:52:18 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:19 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.info" returned: 0 in 0.575s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.020s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562835826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca21a46-c219-4872-bc72-349e6a5c9b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:19Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Creating volume 6ca21a46-c219-4872-bc72-349e6a5c9b64 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:19 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:52:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:19 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 1073741824 Apr 29 16:52:19 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:19 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-98e1444b-7215-4549-b00d-fbca5b081e7a tempest-VolumesSnapshotTestJSON-2126495909 None] Create snapshot completed successfully Apr 29 16:52:20 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 1073741824" returned: 0 in 0.806s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:20 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 Apr 29 16:52:20 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (bd14ac7a-523e-4474-8075-3980895a8786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9ea8cf-62b5-4684-8cf4-b7e2d916e8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9ea8cf-62b5-4684-8cf4-b7e2d916e8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1144905067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0886063d-b52a-40c7-b481-4981c7908045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5077b7e44f4ca087a314f5fa4adf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1c5aa37f-59bd-45b3-ae4b-71f176bd932a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:21Z,use_quota=True,user_id='d0687718d0ea477297a1c437cfd2b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e21d24-ef15-46b3-ba08-f0e480760777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e21d24-ef15-46b3-ba08-f0e480760777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7198e58-862b-4467-8970-9f50eabf3b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7198e58-862b-4467-8970-9f50eabf3b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0886063d-b52a-40c7-b481-4981c7908045', 'volume_name': 'volume-0886063d-b52a-40c7-b481-4981c7908045', 'volume_size': 2, 'snapshot_id': '1c5aa37f-59bd-45b3-ae4b-71f176bd932a'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0bc9b4-ae1e-48a7-96ce-72774d398f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0bc9b4-ae1e-48a7-96ce-72774d398f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdc4543-c8ab-4ea7-bf92-d2ab32e6eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:20 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Volume 0886063d-b52a-40c7-b481-4981c7908045: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0886063d-b52a-40c7-b481-4981c7908045', 'volume_size': 2, 'snapshot_id': '1c5aa37f-59bd-45b3-ae4b-71f176bd932a'} Apr 29 16:52:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:21 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64" returned: 0 in 0.624s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.373s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-1c5aa37f-59bd-45b3-ae4b-71f176bd932a-0886063d-b52a-40c7-b481-4981c7908045" by "_create_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0bdefa-04e2-44ad-bf95-4c28a82bb3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca21a46-c219-4872-bc72-349e6a5c9b64', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dead1f52-ad8c-4029-b39a-00597bebb185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-1c5aa37f-59bd-45b3-ae4b-71f176bd932a-0886063d-b52a-40c7-b481-4981c7908045" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Creating volume 0886063d-b52a-40c7-b481-4981c7908045 from snapshot 1c5aa37f-59bd-45b3-ae4b-71f176bd932a {{(pid=84201) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-0886063d-b52a-40c7-b481-4981c7908045" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-0886063d-b52a-40c7-b481-4981c7908045" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] snapshot: 1c5aa37f-59bd-45b3-ae4b-71f176bd932a, volume: 0886063d-b52a-40c7-b481-4981c7908045, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:52:21 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Volume volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 (6ca21a46-c219-4872-bc72-349e6a5c9b64): created successfully Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dead1f52-ad8c-4029-b39a-00597bebb185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (6e26df52-36d7-4fee-a667-35bea00312b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:21 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d10e517c-d41e-4e94-b5d7-c88e26a7ab9e tempest-VolumesActionsTest-1369079519 None] Created volume successfully. Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7210186-9711-4958-86fd-4d14da6d9fcb]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:21 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a Apr 29 16:52:21 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:21 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a" returned: 0 in 0.699s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d01451-769c-4bb6-ade7-8bb0fb964092]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:21 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed Apr 29 16:52:21 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Acquiring lock "cinder-6ca21a46-c219-4872-bc72-349e6a5c9b64-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Lock "cinder-6ca21a46-c219-4872-bc72-349e6a5c9b64-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Acquiring lock "cinder-quobyte-6ca21a46-c219-4872-bc72-349e6a5c9b64" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Lock "cinder-quobyte-6ca21a46-c219-4872-bc72-349e6a5c9b64" acquired by "delete_volume" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3d1b9a-1b6b-4f38-8aa2-84f0e96512b0]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:22 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 Apr 29 16:52:22 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:22 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed" returned: 0 in 0.699s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:22 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 Apr 29 16:52:22 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:22 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64" returned: 0 in 0.700s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:22 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64 Apr 29 16:52:22 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:23 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-6ca21a46-c219-4872-bc72-349e6a5c9b64" returned: 0 in 1.031s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Lock "cinder-quobyte-6ca21a46-c219-4872-bc72-349e6a5c9b64" released by "delete_volume" :: held 1.813s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:24 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Created reservations ['fa01d1c6-777d-4359-9441-cfcff8705336', '2c89af76-3b22-4462-bab8-112059d7a070', 'dd4e708c-fd0a-4f3c-a09c-75c23445245f', '84a53278-d779-4a13-b603-2f86fc31be4d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:24 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:52:24 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:25 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.117s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:52:25 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Deleted volume successfully. Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0960787c-9728-4aa5-a1a1-5df3487261f0 tempest-VolumesActionsTest-986967491 None] Lock "cinder-6ca21a46-c219-4872-bc72-349e6a5c9b64-delete_volume" released by "delete_volume" :: held 3.372s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (dcedc98a-c2ad-4b77-9d00-e8ab1a3cf694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff8fa00-6662-4e1a-84cc-6583206202af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff8fa00-6662-4e1a-84cc-6583206202af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415733371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b3eebf-9428-4402-9d20-f84a84c2a807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:25Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20219e13-4f87-4df9-af89-2fe1ef4c80e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20219e13-4f87-4df9-af89-2fe1ef4c80e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29226e51-61ce-4688-b94a-1cece72a6b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29226e51-61ce-4688-b94a-1cece72a6b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1b3eebf-9428-4402-9d20-f84a84c2a807', 'volume_name': 'volume-e1b3eebf-9428-4402-9d20-f84a84c2a807', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24609bfe-7f92-48f1-a043-045c7929e4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24609bfe-7f92-48f1-a043-045c7929e4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9961414-627b-4b1e-8e6d-0469269f0b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:25 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Volume e1b3eebf-9428-4402-9d20-f84a84c2a807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1b3eebf-9428-4402-9d20-f84a84c2a807', 'volume_size': 1} Apr 29 16:52:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:27 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045" returned: 0 in 4.819s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:27 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b3792d-3b40-40c8-871f-a82a5af5b6a2]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:27 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed Apr 29 16:52:27 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:28 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed" returned: 0 in 0.837s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:52:28 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Converted 1024.00 MB image at 212.45 MB/s Apr 29 16:52:28 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 is being set with open permissions: ugo+rw Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:28 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 Apr 29 16:52:28 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:28 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045" returned: 0 in 0.577s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-0886063d-b52a-40c7-b481-4981c7908045" released by "_copy_volume_from_snapshot" :: held 7.732s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-1c5aa37f-59bd-45b3-ae4b-71f176bd932a-0886063d-b52a-40c7-b481-4981c7908045" released by "_create_volume_from_snapshot" :: held 7.761s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.788s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.258s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415733371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b3eebf-9428-4402-9d20-f84a84c2a807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:25Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Creating volume e1b3eebf-9428-4402-9d20-f84a84c2a807 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:28 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:28 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 1073741824 Apr 29 16:52:28 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=77,cinder:INSERT=24,cinder:UPDATE=88,cinder:DELETE=12 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdc4543-c8ab-4ea7-bf92-d2ab32e6eccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0886063d-b52a-40c7-b481-4981c7908045', 'volume_size': 2, 'snapshot_id': '1c5aa37f-59bd-45b3-ae4b-71f176bd932a'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5029f4ef-c1f6-4814-a371-50a5e0f1da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:28 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Volume volume-0886063d-b52a-40c7-b481-4981c7908045 (0886063d-b52a-40c7-b481-4981c7908045): created successfully Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5029f4ef-c1f6-4814-a371-50a5e0f1da4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (bd14ac7a-523e-4474-8075-3980895a8786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:28 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6d47acfc-582e-4bff-b700-3ee70337253d tempest-VolumesSnapshotTestJSON-2126495909 None] Created volume successfully. Apr 29 16:52:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-0886063d-b52a-40c7-b481-4981c7908045-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-0886063d-b52a-40c7-b481-4981c7908045-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-0886063d-b52a-40c7-b481-4981c7908045" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-0886063d-b52a-40c7-b481-4981c7908045" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:29 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8ea94e-2f47-4041-a3a7-44cf215da271]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:29 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 Apr 29 16:52:29 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:29 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 1073741824" returned: 0 in 0.802s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:29 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 Apr 29 16:52:29 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:30 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045" returned: 0 in 0.720s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:30 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807" returned: 0 in 0.580s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:30 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045 Apr 29 16:52:30 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9961414-627b-4b1e-8e6d-0469269f0b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b3eebf-9428-4402-9d20-f84a84c2a807', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3e6d4f-1a6a-45bb-84ac-82fd335fd9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:30 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Volume volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 (e1b3eebf-9428-4402-9d20-f84a84c2a807): created successfully Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3e6d4f-1a6a-45bb-84ac-82fd335fd9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (dcedc98a-c2ad-4b77-9d00-e8ab1a3cf694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-abb10641-25ce-4673-9794-ac6694a80284 tempest-VolumesActionsTest-1369079519 None] Created volume successfully. Apr 29 16:52:30 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0886063d-b52a-40c7-b481-4981c7908045" returned: 0 in 0.582s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-0886063d-b52a-40c7-b481-4981c7908045" released by "delete_volume" :: held 1.347s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Created reservations ['5e7df8cb-41f5-47db-9574-db2750ed5f49', 'a3515158-d1e8-4b4e-9f0c-dfd6d99193d7', '00ab2f05-7cbe-4611-9cbc-d793d570622e', 'bcd5319b-689e-40bc-956d-00453dabf18d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Acquiring lock "cinder-e1b3eebf-9428-4402-9d20-f84a84c2a807-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:30 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:52:30 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Lock "cinder-e1b3eebf-9428-4402-9d20-f84a84c2a807-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:30 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Acquiring lock "cinder-quobyte-e1b3eebf-9428-4402-9d20-f84a84c2a807" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Lock "cinder-quobyte-e1b3eebf-9428-4402-9d20-f84a84c2a807" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe196859-e4c5-4970-9155-3f9e3e26ed62]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:31 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 Apr 29 16:52:31 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:31 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.607s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:52:31 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Deleted volume successfully. Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d40bcacf-2946-4d32-b843-eb14a14ea822 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-0886063d-b52a-40c7-b481-4981c7908045-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-1c5aa37f-59bd-45b3-ae4b-71f176bd932a-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-1c5aa37f-59bd-45b3-ae4b-71f176bd932a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-984f098e-49c7-45ec-8a53-d8b1eadf99ed" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-984f098e-49c7-45ec-8a53-d8b1eadf99ed" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-1c5aa37f-59bd-45b3-ae4b-71f176bd932a" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-1c5aa37f-59bd-45b3-ae4b-71f176bd932a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Deleting offline snapshot 1c5aa37f-59bd-45b3-ae4b-71f176bd932a of volume 984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] snapshot_file for this snap is: volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d13501c-c404-45d1-a859-1c94a02a4c3d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:31 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807" returned: 0 in 0.775s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:31 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807 Apr 29 16:52:31 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:31 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a Apr 29 16:52:31 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:32 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-e1b3eebf-9428-4402-9d20-f84a84c2a807" returned: 0 in 0.594s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Lock "cinder-quobyte-e1b3eebf-9428-4402-9d20-f84a84c2a807" released by "delete_volume" :: held 1.422s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Created reservations ['0ecae123-f45e-4193-b053-b58141033fae', '757d3e72-be60-4a28-9638-6705a3a4822b', 'bdcf0127-2cc1-4f61-86b1-b37bf51e4d1a', 'ae36db15-0200-4036-80c8-2744d425b32d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:32 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a" returned: 0 in 0.758s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[71136913-2839-463a-8b0e-6f68d5b48b15]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:32 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:52:32 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:32 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed Apr 29 16:52:32 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:33 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.629s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:52:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Deleted volume successfully. Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72535863-cb2f-42cf-a6b5-379ced6c31a3 tempest-VolumesActionsTest-986967491 None] Lock "cinder-e1b3eebf-9428-4402-9d20-f84a84c2a807-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:33 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed" returned: 0 in 0.724s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:33 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a Apr 29 16:52:33 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (7534e2d5-6525-4211-a9ef-e2cf5803ec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b83844-dcc6-4838-8fff-6ad1b85c3395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b83844-dcc6-4838-8fff-6ad1b85c3395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-359278669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31deca1d-372b-4be5-a3ae-86ed89f2e75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:34Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c9d090-c713-4bbf-a943-265074fc14f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c9d090-c713-4bbf-a943-265074fc14f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81912d9-69a1-4c46-8d0a-3a33ce8991b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81912d9-69a1-4c46-8d0a-3a33ce8991b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31deca1d-372b-4be5-a3ae-86ed89f2e75b', 'volume_name': 'volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafa3ebe-a454-410d-b300-aef0c010ff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafa3ebe-a454-410d-b300-aef0c010ff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1454d78-836d-4ba1-a3e3-4e7a375b0b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:33 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Volume 31deca1d-372b-4be5-a3ae-86ed89f2e75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b', 'volume_size': 1} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-359278669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31deca1d-372b-4be5-a3ae-86ed89f2e75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab574e403b6b48c3abc91bca229d6eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:34Z,use_quota=True,user_id='f4f393bb47c14e78980473cf33f0f53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Creating volume 31deca1d-372b-4be5-a3ae-86ed89f2e75b {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:33 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:33 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b 1073741824 Apr 29 16:52:33 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:33 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a" returned: 0 in 0.688s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:33 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a Apr 29 16:52:33 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:34 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b 1073741824" returned: 0 in 0.753s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:34 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b Apr 29 16:52:34 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:34 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed.1c5aa37f-59bd-45b3-ae4b-71f176bd932a" returned: 0 in 0.616s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-1c5aa37f-59bd-45b3-ae4b-71f176bd932a" released by "_delete_snapshot" :: held 2.908s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-984f098e-49c7-45ec-8a53-d8b1eadf99ed" released by "delete_snapshot" :: held 2.936s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:34 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Created reservations ['93878a5c-55c5-4b56-929c-c8a07a81a107', 'b98d5455-8207-464c-b2bd-efb156b4f287', '9f672cc8-5777-4626-8020-a57553348835', '0c5d9fd4-cd92-4e1e-a28e-2565e7528b85'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:34 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Delete snapshot completed successfully. Apr 29 16:52:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-70dbac0e-7a2f-4f5f-8461-b39e221ec890 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-1c5aa37f-59bd-45b3-ae4b-71f176bd932a-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-984f098e-49c7-45ec-8a53-d8b1eadf99ed-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-984f098e-49c7-45ec-8a53-d8b1eadf99ed-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-984f098e-49c7-45ec-8a53-d8b1eadf99ed" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-984f098e-49c7-45ec-8a53-d8b1eadf99ed" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c63643-93a8-4ecb-8446-e25260c2c81a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:35 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b" returned: 0 in 0.635s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1454d78-836d-4ba1-a3e3-4e7a375b0b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb762e32-d3cb-46e3-abf0-f74fb780d006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:35 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Volume volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b (31deca1d-372b-4be5-a3ae-86ed89f2e75b): created successfully Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb762e32-d3cb-46e3-abf0-f74fb780d006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:35 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed Apr 29 16:52:35 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Flow 'volume_create_manager' (7534e2d5-6525-4211-a9ef-e2cf5803ec0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ef0e78f3-40eb-4cb2-9353-fa5a0b9f00d0 tempest-VolumesActionsTest-1369079519 None] Created volume successfully. Apr 29 16:52:35 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed" returned: 0 in 0.729s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:35 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed Apr 29 16:52:35 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:36 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-984f098e-49c7-45ec-8a53-d8b1eadf99ed" returned: 0 in 0.602s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Acquiring lock "cinder-31deca1d-372b-4be5-a3ae-86ed89f2e75b-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-984f098e-49c7-45ec-8a53-d8b1eadf99ed" released by "delete_volume" :: held 1.394s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Lock "cinder-31deca1d-372b-4be5-a3ae-86ed89f2e75b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Acquiring lock "cinder-quobyte-31deca1d-372b-4be5-a3ae-86ed89f2e75b" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Created reservations ['0cffbda2-10b2-4a02-9b74-5d475b41053e', '96428000-e45c-4421-a949-41a637cef4f2', '37b8d167-c327-41ec-b0fd-5dfa78d359bf', '6af61afb-805d-4657-8dc5-f5e3dce0af52'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Lock "cinder-quobyte-31deca1d-372b-4be5-a3ae-86ed89f2e75b" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[651560c7-f5b9-4fe0-9057-c61afb3b0e31]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:36 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:52:36 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:36 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b Apr 29 16:52:36 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:37 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.595s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:52:37 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Deleted volume successfully. Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1aa86468-51dc-4b21-a40f-44e06831fe1b tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-984f098e-49c7-45ec-8a53-d8b1eadf99ed-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:37 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b" returned: 0 in 0.737s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:37 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b Apr 29 16:52:37 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (b9b15b18-5f77-448b-bf8a-f4b9456f8ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cafa9bb-fd3c-46bd-a6be-eeb368019350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cafa9bb-fd3c-46bd-a6be-eeb368019350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-422852295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653522a6-b2f2-426b-82d2-9d6c4928bd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5077b7e44f4ca087a314f5fa4adf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:38Z,use_quota=True,user_id='d0687718d0ea477297a1c437cfd2b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6ba44c-d32c-4b88-a37a-dbd26864c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6ba44c-d32c-4b88-a37a-dbd26864c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215efb5f-4e6c-47fb-8f69-ee4383f97572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215efb5f-4e6c-47fb-8f69-ee4383f97572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653522a6-b2f2-426b-82d2-9d6c4928bd4c', 'volume_name': 'volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59549147-ec3f-4ca4-96f9-df8dd85233e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59549147-ec3f-4ca4-96f9-df8dd85233e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd86f5bc-c701-401a-859e-ea0f1cdaaf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:37 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Volume 653522a6-b2f2-426b-82d2-9d6c4928bd4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c', 'volume_size': 1} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-422852295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653522a6-b2f2-426b-82d2-9d6c4928bd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5077b7e44f4ca087a314f5fa4adf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:38Z,use_quota=True,user_id='d0687718d0ea477297a1c437cfd2b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Creating volume 653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:37 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:37 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c 1073741824 Apr 29 16:52:37 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:37 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-31deca1d-372b-4be5-a3ae-86ed89f2e75b" returned: 0 in 0.618s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Lock "cinder-quobyte-31deca1d-372b-4be5-a3ae-86ed89f2e75b" released by "delete_volume" :: held 1.397s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:37 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Created reservations ['9eae2f68-85c7-4aa8-83ed-266fd892c311', '65301254-9be8-4084-b0e0-2645df376011', '23ab943b-74da-43ff-ba47-189db1ae7a6c', '3427e2d1-8285-4144-ae8a-6c415853467a'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:38 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:52:38 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:38 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c 1073741824" returned: 0 in 0.754s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:38 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c Apr 29 16:52:38 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:38 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.619s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:52:38 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Deleted volume successfully. Apr 29 16:52:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-fb34f902-562d-49e3-b8c6-5123b237acfa tempest-VolumesActionsTest-1369079519 None] Lock "cinder-31deca1d-372b-4be5-a3ae-86ed89f2e75b-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:39 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c" returned: 0 in 0.630s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd86f5bc-c701-401a-859e-ea0f1cdaaf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67768dd-beda-40ca-a9b6-efb9962c5714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:39 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Volume volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c (653522a6-b2f2-426b-82d2-9d6c4928bd4c): created successfully Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67768dd-beda-40ca-a9b6-efb9962c5714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (b9b15b18-5f77-448b-bf8a-f4b9456f8ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:39 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f24510a9-d92e-4826-ad7f-9b90dc733e5a tempest-VolumesSnapshotTestJSON-2126495909 None] Created volume successfully. Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Creating offline snapshot 446a5568-c04e-40d2-950e-ddab2159554b of volume 653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[603c589d-3ed4-490f-9be3-76eed2c6aa38]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:40 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c Apr 29 16:52:40 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:40 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c" returned: 0 in 0.764s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:40 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b 1G Apr 29 16:52:40 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:41 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b 1G" returned: 0 in 0.835s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:41 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b Apr 29 16:52:41 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:42 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b" returned: 0 in 0.701s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:42 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b is being set with open permissions: ugo+rw Apr 29 16:52:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:42 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b Apr 29 16:52:42 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:42 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b" returned: 0 in 0.653s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:42 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.info Apr 29 16:52:42 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:43 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.info" returned: 0 in 0.630s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:43 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.info is being set with open permissions: ugo+rw Apr 29 16:52:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:43 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.info Apr 29 16:52:43 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:44 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.info" returned: 0 in 0.646s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.331s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:44 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f444fbde-9213-4cbc-90c7-3b96cd0ccb56 tempest-VolumesSnapshotTestJSON-2126495909 None] Create snapshot completed successfully Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (f3a92622-6c9a-4760-8589-e51e27ec073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8728fd2-2aa2-4289-8456-eb6ffab36a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8728fd2-2aa2-4289-8456-eb6ffab36a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-686734730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703a1652-47b6-4a24-9d13-63822d4975dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5077b7e44f4ca087a314f5fa4adf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=446a5568-c04e-40d2-950e-ddab2159554b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:46Z,use_quota=True,user_id='d0687718d0ea477297a1c437cfd2b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c88dd4d-ae8a-43c0-946f-f040e779c2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c88dd4d-ae8a-43c0-946f-f040e779c2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfebf42-9322-4e16-8d10-507bccb1e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfebf42-9322-4e16-8d10-507bccb1e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '703a1652-47b6-4a24-9d13-63822d4975dc', 'volume_name': 'volume-703a1652-47b6-4a24-9d13-63822d4975dc', 'volume_size': 1, 'snapshot_id': '446a5568-c04e-40d2-950e-ddab2159554b'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75bae75-851f-46f2-9c49-993184b25c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75bae75-851f-46f2-9c49-993184b25c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f076313-2a10-463e-a0b2-0befec806100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:45 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Volume 703a1652-47b6-4a24-9d13-63822d4975dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-703a1652-47b6-4a24-9d13-63822d4975dc', 'volume_size': 1, 'snapshot_id': '446a5568-c04e-40d2-950e-ddab2159554b'} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-446a5568-c04e-40d2-950e-ddab2159554b-703a1652-47b6-4a24-9d13-63822d4975dc" by "_create_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-446a5568-c04e-40d2-950e-ddab2159554b-703a1652-47b6-4a24-9d13-63822d4975dc" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Creating volume 703a1652-47b6-4a24-9d13-63822d4975dc from snapshot 446a5568-c04e-40d2-950e-ddab2159554b {{(pid=84201) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-703a1652-47b6-4a24-9d13-63822d4975dc" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-703a1652-47b6-4a24-9d13-63822d4975dc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] snapshot: 446a5568-c04e-40d2-950e-ddab2159554b, volume: 703a1652-47b6-4a24-9d13-63822d4975dc, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d2a13b-bb38-41a8-ad81-750b8c1863ba]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:45 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b Apr 29 16:52:45 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:46 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b" returned: 0 in 0.770s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:52:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:52:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:52:46 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f4c266-9916-4e17-8e91-20cfadacfde1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:46 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c Apr 29 16:52:46 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:47 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c" returned: 0 in 0.759s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:47 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:52:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:47 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc Apr 29 16:52:47 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Flow 'volume_create_manager' (37463a3b-c79f-4909-b124-91cb22222fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbcd162-c10d-42b1-b615-4e434c61917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbcd162-c10d-42b1-b615-4e434c61917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-620530851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0f7b45-83fe-4afd-a076-74f99f2667a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d0ad43160e43a5804cc84dea7b31dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:49Z,use_quota=True,user_id='73672d65aa014fc68ce5dbabb0a7d692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f9e61f-fcdc-4310-afcc-e57c71170c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f9e61f-fcdc-4310-afcc-e57c71170c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5c77d2-8063-45d4-89f6-aa965f0d6d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5c77d2-8063-45d4-89f6-aa965f0d6d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0f7b45-83fe-4afd-a076-74f99f2667a9', 'volume_name': 'volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3e4fc0-bb03-4c03-ba52-2dd9ae2aa5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3e4fc0-bb03-4c03-ba52-2dd9ae2aa5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee67c1b-d6dd-4278-b6c3-5832c93892d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:49 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Volume 1c0f7b45-83fe-4afd-a076-74f99f2667a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9', 'volume_size': 1} Apr 29 16:52:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:52 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc" returned: 0 in 4.706s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:52 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[486e9c0c-254b-44a1-86d8-35b243a68945]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:52 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c Apr 29 16:52:52 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:52 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c" returned: 0 in 0.876s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:52 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:52:52 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Converted 1024.00 MB image at 217.57 MB/s Apr 29 16:52:52 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc is being set with open permissions: ugo+rw Apr 29 16:52:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:52 devstack sudo[91829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc Apr 29 16:52:52 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:53 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc" returned: 0 in 0.578s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-703a1652-47b6-4a24-9d13-63822d4975dc" released by "_copy_volume_from_snapshot" :: held 7.788s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-446a5568-c04e-40d2-950e-ddab2159554b-703a1652-47b6-4a24-9d13-63822d4975dc" released by "_create_volume_from_snapshot" :: held 7.817s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.832s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.815s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-620530851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0f7b45-83fe-4afd-a076-74f99f2667a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d0ad43160e43a5804cc84dea7b31dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:52:49Z,use_quota=True,user_id='73672d65aa014fc68ce5dbabb0a7d692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Creating volume 1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:52:53 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=114,cinder:DELETE=8,cinder:SELECT=104,cinder:INSERT=25 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:52:53 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 1073741824 Apr 29 16:52:53 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f076313-2a10-463e-a0b2-0befec806100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703a1652-47b6-4a24-9d13-63822d4975dc', 'volume_size': 1, 'snapshot_id': '446a5568-c04e-40d2-950e-ddab2159554b'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a83c8b-f61e-4d16-b596-2fa126c30f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:53 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Volume volume-703a1652-47b6-4a24-9d13-63822d4975dc (703a1652-47b6-4a24-9d13-63822d4975dc): created successfully Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a83c8b-f61e-4d16-b596-2fa126c30f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Flow 'volume_create_manager' (f3a92622-6c9a-4760-8589-e51e27ec073d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:53 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-96de0b25-ecfe-4c66-b0b9-198cd1f22a19 tempest-VolumesSnapshotTestJSON-2126495909 None] Created volume successfully. Apr 29 16:52:54 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 1073741824" returned: 0 in 0.786s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-703a1652-47b6-4a24-9d13-63822d4975dc-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-703a1652-47b6-4a24-9d13-63822d4975dc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:54 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 Apr 29 16:52:54 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-703a1652-47b6-4a24-9d13-63822d4975dc" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-703a1652-47b6-4a24-9d13-63822d4975dc" acquired by "delete_volume" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d808689-cc78-4ef5-8509-85ad2ad4cd75]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:54 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc Apr 29 16:52:54 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:54 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9" returned: 0 in 0.603s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee67c1b-d6dd-4278-b6c3-5832c93892d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0540c63b-4bd5-4b54-b3f0-0a864c3ba33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:52:54 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Volume volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 (1c0f7b45-83fe-4afd-a076-74f99f2667a9): created successfully Apr 29 16:52:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0540c63b-4bd5-4b54-b3f0-0a864c3ba33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Flow 'volume_create_manager' (37463a3b-c79f-4909-b124-91cb22222fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:52:55 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b4df104f-f7c5-4411-aa8d-43da3b6fcfb6 tempest-VolumesDeleteCascade-1534613731 None] Created volume successfully. Apr 29 16:52:55 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc" returned: 0 in 0.705s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:55 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc Apr 29 16:52:55 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:55 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-703a1652-47b6-4a24-9d13-63822d4975dc" returned: 0 in 0.582s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-703a1652-47b6-4a24-9d13-63822d4975dc" released by "delete_volume" :: held 1.329s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Created reservations ['5471f2d1-4fe2-424e-847e-040e223e4b3b', '84ccbe8e-3578-4e2b-90e4-883dd15d25c0', '0b996941-60f6-4a76-924d-838f127cbdd4', 'e5e2b994-fb35-469f-8d73-1235b6ad8249'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:52:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:55 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:52:55 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Creating offline snapshot c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 of volume 1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7596a79d-8546-450f-9a54-90e7bf781d4e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:56 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 Apr 29 16:52:56 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:56 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.604s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:52:56 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Deleted volume successfully. Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f4f8c687-2df1-443b-8fdc-8493f697d931 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-703a1652-47b6-4a24-9d13-63822d4975dc-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-446a5568-c04e-40d2-950e-ddab2159554b-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-446a5568-c04e-40d2-950e-ddab2159554b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-653522a6-b2f2-426b-82d2-9d6c4928bd4c" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-653522a6-b2f2-426b-82d2-9d6c4928bd4c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-446a5568-c04e-40d2-950e-ddab2159554b" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-446a5568-c04e-40d2-950e-ddab2159554b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Deleting offline snapshot 446a5568-c04e-40d2-950e-ddab2159554b of volume 653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] snapshot_file for this snap is: volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2accb798-dc84-4921-bb3f-bd17c74f31da]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:56 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b Apr 29 16:52:56 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:56 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9" returned: 0 in 0.739s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:56 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 1G Apr 29 16:52:56 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:57 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b" returned: 0 in 0.714s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:52:57 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd61821b-a1b6-4ae9-8b1c-349981841647]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:52:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:57 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c Apr 29 16:52:57 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:57 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 1G" returned: 0 in 0.793s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:57 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 Apr 29 16:52:57 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:58 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c" returned: 0 in 0.741s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:58 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b Apr 29 16:52:58 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:58 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" returned: 0 in 0.695s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:58 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 is being set with open permissions: ugo+rw Apr 29 16:52:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:58 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 Apr 29 16:52:58 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:58 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b" returned: 0 in 0.726s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:58 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b Apr 29 16:52:58 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:59 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" returned: 0 in 0.610s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:59 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.info Apr 29 16:52:59 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:59 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c.446a5568-c04e-40d2-950e-ddab2159554b" returned: 0 in 0.596s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-446a5568-c04e-40d2-950e-ddab2159554b" released by "_delete_snapshot" :: held 2.882s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-653522a6-b2f2-426b-82d2-9d6c4928bd4c" released by "delete_snapshot" :: held 2.905s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Created reservations ['1deefffe-c742-4925-90df-7dff04ee6610', '12e35042-edf9-45f4-b7d3-604f992653fd', 'bf078aa4-b2b1-43b6-8fda-10e07b7a07cf', '913ee0b1-9202-41a7-b196-822a73ef8d94'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:52:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Delete snapshot completed successfully. Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-90e3106b-195d-4ce8-853a-e5d7f1affc84 tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-446a5568-c04e-40d2-950e-ddab2159554b-delete_snapshot" released by "delete_snapshot" :: held 3.049s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:52:59 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.info" returned: 0 in 0.653s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:52:59 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.info is being set with open permissions: ugo+rw Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:52:59 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.info Apr 29 16:52:59 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-653522a6-b2f2-426b-82d2-9d6c4928bd4c-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-653522a6-b2f2-426b-82d2-9d6c4928bd4c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-653522a6-b2f2-426b-82d2-9d6c4928bd4c" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:52:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-653522a6-b2f2-426b-82d2-9d6c4928bd4c" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:00 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfb6a7d-774e-4e17-81c7-263d265ac98e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:00 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c Apr 29 16:53:00 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:00 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.info" returned: 0 in 0.629s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.214s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:00 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-3b9061fa-50cb-4375-b5ed-c8bc663657cb tempest-VolumesDeleteCascade-1534613731 None] Create snapshot completed successfully Apr 29 16:53:00 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c" returned: 0 in 0.733s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:00 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c Apr 29 16:53:00 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:01 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-653522a6-b2f2-426b-82d2-9d6c4928bd4c" returned: 0 in 0.632s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-653522a6-b2f2-426b-82d2-9d6c4928bd4c" released by "delete_volume" :: held 1.430s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Created reservations ['15600078-d05a-419f-a1b5-5bf23a519899', '87996493-fc67-4586-81f2-a7cc86f9f6f2', '5ed11ffb-6959-495b-ab11-24f9c5bc9123', '89408fb3-8b9f-44fa-b8ac-c0fbd3b12baf'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Creating offline snapshot 5ac746b1-47fa-4642-be44-91c5cbb58a05 of volume 1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4b1af4-fe47-4a3d-80c2-989879f907ca]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:01 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:01 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:01 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 Apr 29 16:53:01 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-61c84056-7e12-4d03-92b2-c427a60fc881-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:02 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.614s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-61c84056-7e12-4d03-92b2-c427a60fc881-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:02 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Deleted volume successfully. Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-95ccecdf-841d-42eb-82fa-8534b2b66a2f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-653522a6-b2f2-426b-82d2-9d6c4928bd4c-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "cinder-quobyte-61c84056-7e12-4d03-92b2-c427a60fc881" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-61c84056-7e12-4d03-92b2-c427a60fc881" acquired by "delete_volume" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cd0250-db82-4aa1-830f-4a8dcb234e68]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:02 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" returned: 0 in 0.803s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:53:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:02 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 Apr 29 16:53:02 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:02 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 1G Apr 29 16:53:02 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:03 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881" returned: 0 in 0.715s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:03 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881 Apr 29 16:53:03 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:03 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 1G" returned: 0 in 0.785s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:03 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 Apr 29 16:53:03 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:03 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-61c84056-7e12-4d03-92b2-c427a60fc881" returned: 0 in 0.593s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-quobyte-61c84056-7e12-4d03-92b2-c427a60fc881" released by "delete_volume" :: held 1.366s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Created reservations ['28d00cdb-53f2-4027-a383-85dfb1b7a5ac', 'be50fd39-1c52-4d3a-a287-c7a333b68f3a', '51c91b07-1273-4e61-92c5-55973d12d135', 'aca6d359-9b4e-479d-8f0d-80ef06238469'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:03 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:03 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:03 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05" returned: 0 in 0.670s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:03 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 is being set with open permissions: ugo+rw Apr 29 16:53:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:03 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 Apr 29 16:53:03 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:04 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.611s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:04 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Deleted volume successfully. Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7c8e2105-9bc4-40f2-9cb9-d5efc76b385f tempest-VolumesSnapshotTestJSON-2126495909 None] Lock "cinder-61c84056-7e12-4d03-92b2-c427a60fc881-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:04 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05" returned: 0 in 0.619s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:04 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-2a00d4d4-a0ab-469f-be1b-7896f1fa553d tempest-VolumesDeleteCascade-1534613731 None] Create snapshot completed successfully Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-1c0f7b45-83fe-4afd-a076-74f99f2667a9-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-1c0f7b45-83fe-4afd-a076-74f99f2667a9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Performing cascade delete. {{(pid=84201) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-5ac746b1-47fa-4642-be44-91c5cbb58a05-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-5ac746b1-47fa-4642-be44-91c5cbb58a05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-1c0f7b45-83fe-4afd-a076-74f99f2667a9" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:04 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:04 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-1c0f7b45-83fe-4afd-a076-74f99f2667a9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-5ac746b1-47fa-4642-be44-91c5cbb58a05" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-5ac746b1-47fa-4642-be44-91c5cbb58a05" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Deleting offline snapshot 5ac746b1-47fa-4642-be44-91c5cbb58a05 of volume 1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] snapshot_file for this snap is: volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e9b063-3847-4511-92f0-e1819b3e1f29]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:05 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 Apr 29 16:53:05 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:05 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.713s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:05 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05" returned: 0 in 0.821s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:53:05 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78799be-1400-4e2e-9490-5b387008f6fa]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:05 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 Apr 29 16:53:05 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:06 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" returned: 0 in 0.744s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:06 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:53:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:06 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 Apr 29 16:53:06 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:07 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05" returned: 0 in 0.744s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:07 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05 Apr 29 16:53:07 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:07 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.5ac746b1-47fa-4642-be44-91c5cbb58a05" returned: 0 in 0.627s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-5ac746b1-47fa-4642-be44-91c5cbb58a05" released by "_delete_snapshot" :: held 3.055s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-1c0f7b45-83fe-4afd-a076-74f99f2667a9" released by "delete_snapshot" :: held 3.094s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Created reservations ['e14ae1e7-2595-4223-8624-e0daf6da13da', '43fdb6bf-6b84-49d6-a83c-498b1396aa00', 'afa9572b-abd7-40f1-a97f-d017cba71eda', 'aa0bf904-0696-41dc-8bff-299bd7a6a365'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:08 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Delete snapshot completed successfully. Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-5ac746b1-47fa-4642-be44-91c5cbb58a05-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-c0c5fd04-693b-4c5e-bd71-64f1802dc4b2-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-c0c5fd04-693b-4c5e-bd71-64f1802dc4b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-1c0f7b45-83fe-4afd-a076-74f99f2667a9" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-1c0f7b45-83fe-4afd-a076-74f99f2667a9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Deleting offline snapshot c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 of volume 1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] snapshot_file for this snap is: volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b565e6a8-d329-4d17-822d-9c2aa497d2d5]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:08 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 Apr 29 16:53:08 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:09 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" returned: 0 in 0.813s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:53:09 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b21486-c6e2-4e24-b0ac-093624660050]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:09 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 Apr 29 16:53:09 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:09 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9" returned: 0 in 0.735s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:09 devstack sudo[91972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 Apr 29 16:53:09 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:10 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" returned: 0 in 0.708s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:10 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2 Apr 29 16:53:10 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Flow 'volume_create_manager' (e929097a-a92d-46c8-a432-4eaac6ef9edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c06f47b-cdfa-482c-9b13-55b57ac3a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:11 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9.c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" returned: 0 in 0.616s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c06f47b-cdfa-482c-9b13-55b57ac3a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-798852216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599f7f26-aec1-41be-a827-02a499a33edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d991faf5ed954df8a461e22894b4b4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:11Z,use_quota=True,user_id='724843ac90a24a7db9c481780dca1800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b094344-2384-4e62-a68c-3ee9dee7a606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b094344-2384-4e62-a68c-3ee9dee7a606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f63a04-8fed-4d24-9fba-442529513196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f63a04-8fed-4d24-9fba-442529513196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599f7f26-aec1-41be-a827-02a499a33edf', 'volume_name': 'volume-599f7f26-aec1-41be-a827-02a499a33edf', 'volume_size': 2}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a87eec9-9bb4-458d-a1e9-373f45213fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a87eec9-9bb4-458d-a1e9-373f45213fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d55700-dde7-47af-bbf8-4dc39713e96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:11 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Volume 599f7f26-aec1-41be-a827-02a499a33edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599f7f26-aec1-41be-a827-02a499a33edf', 'volume_size': 2} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-798852216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599f7f26-aec1-41be-a827-02a499a33edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d991faf5ed954df8a461e22894b4b4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:11Z,use_quota=True,user_id='724843ac90a24a7db9c481780dca1800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Creating volume 599f7f26-aec1-41be-a827-02a499a33edf {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:11 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf 2147483648 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-c0c5fd04-693b-4c5e-bd71-64f1802dc4b2" released by "_delete_snapshot" :: held 3.052s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-1c0f7b45-83fe-4afd-a076-74f99f2667a9" released by "delete_snapshot" :: held 3.084s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:11 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf 2147483648 Apr 29 16:53:11 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Created reservations ['8e43897e-f2d4-4489-894b-4453ac804d96', '23a52242-1ad3-42fd-8f81-3b3b792097fb', 'ed102379-85c3-4add-a3c9-b3df4c37cc76', '9ee4dde4-a877-4b90-b8e5-52105c44bbf9'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Delete snapshot completed successfully. Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-c0c5fd04-693b-4c5e-bd71-64f1802dc4b2-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Snapshots deleted, issuing volume delete {{(pid=84201) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-1c0f7b45-83fe-4afd-a076-74f99f2667a9" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-1c0f7b45-83fe-4afd-a076-74f99f2667a9" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df81fa-9451-46c0-9962-208f9e3a2f77]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:11 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 Apr 29 16:53:11 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:12 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf 2147483648" returned: 0 in 0.808s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:12 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf Apr 29 16:53:12 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:12 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9" returned: 0 in 0.766s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:12 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9 Apr 29 16:53:12 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:12 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf" returned: 0 in 0.571s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d55700-dde7-47af-bbf8-4dc39713e96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599f7f26-aec1-41be-a827-02a499a33edf', 'volume_size': 2}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b4079d-ea48-4d35-a17f-8ab7d9850cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:12 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Volume volume-599f7f26-aec1-41be-a827-02a499a33edf (599f7f26-aec1-41be-a827-02a499a33edf): created successfully Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b4079d-ea48-4d35-a17f-8ab7d9850cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Flow 'volume_create_manager' (e929097a-a92d-46c8-a432-4eaac6ef9edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:12 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-865aa2de-6687-46d3-9df7-c058a329c253 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Created volume successfully. Apr 29 16:53:12 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1c0f7b45-83fe-4afd-a076-74f99f2667a9" returned: 0 in 0.612s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-1c0f7b45-83fe-4afd-a076-74f99f2667a9" released by "delete_volume" :: held 1.445s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Created reservations ['2b028784-a571-446a-b32d-48436c3bce1a', '1be02306-fe32-4966-a5cb-44524fd33199', '68fed778-7f58-43aa-a258-eccb0507cdcf', '35398a82-c34e-45d4-90b1-dbaaf548f13e'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:12 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:12 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Creating offline snapshot f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 of volume 599f7f26-aec1-41be-a827-02a499a33edf {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4434f-6287-40d2-8648-5181206613c1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:13 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.616s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:13 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Deleted volume successfully. Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-abc4f80f-f9ad-477c-b509-2778bca6af61 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-1c0f7b45-83fe-4afd-a076-74f99f2667a9-delete_volume" released by "delete_volume" :: held 8.870s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:13 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf Apr 29 16:53:13 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Flow 'volume_create_manager' (e4e2003a-773d-4765-9520-74f0eaad843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c04c35-020b-4fe0-8a21-c68313fa60ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c04c35-020b-4fe0-8a21-c68313fa60ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-711499954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1c3906-294c-4eb1-9b8d-a12be0e7d481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d0ad43160e43a5804cc84dea7b31dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:14Z,use_quota=True,user_id='73672d65aa014fc68ce5dbabb0a7d692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d18d1d-9f1d-45fb-89de-1a456c6c66e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d18d1d-9f1d-45fb-89de-1a456c6c66e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fec290-a548-4436-8581-6fb93b6aea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fec290-a548-4436-8581-6fb93b6aea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1c3906-294c-4eb1-9b8d-a12be0e7d481', 'volume_name': 'volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f58f590-6d1d-4a70-94d6-4d5ac05e535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f58f590-6d1d-4a70-94d6-4d5ac05e535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16229439-4cdb-49df-b468-09950d33f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:14 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Volume bd1c3906-294c-4eb1-9b8d-a12be0e7d481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481', 'volume_size': 1} Apr 29 16:53:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:14 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf" returned: 0 in 0.764s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 2G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:14 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 2G Apr 29 16:53:14 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:14 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 2G" returned: 0 in 0.765s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599f7f26-aec1-41be-a827-02a499a33edf -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:15 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599f7f26-aec1-41be-a827-02a499a33edf -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 Apr 29 16:53:15 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:15 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599f7f26-aec1-41be-a827-02a499a33edf -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46" returned: 0 in 0.649s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:15 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 is being set with open permissions: ugo+rw Apr 29 16:53:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:15 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 Apr 29 16:53:15 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:16 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46" returned: 0 in 0.587s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:16 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.info Apr 29 16:53:16 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:16 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.info" returned: 0 in 0.591s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:16 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.info is being set with open permissions: ugo+rw Apr 29 16:53:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:16 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.info Apr 29 16:53:16 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:17 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.info" returned: 0 in 0.578s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.026s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.436s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-711499954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1c3906-294c-4eb1-9b8d-a12be0e7d481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d0ad43160e43a5804cc84dea7b31dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:14Z,use_quota=True,user_id='73672d65aa014fc68ce5dbabb0a7d692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Creating volume bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:17 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:17 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 1073741824 Apr 29 16:53:17 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:17 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-05187c3c-5293-49be-8eaa-ba33bd54a9c8 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Create snapshot completed successfully Apr 29 16:53:18 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 1073741824" returned: 0 in 0.761s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:18 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 Apr 29 16:53:18 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Acquiring lock "cinder-f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Acquiring lock "cinder-quobyte-599f7f26-aec1-41be-a827-02a499a33edf" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-quobyte-599f7f26-aec1-41be-a827-02a499a33edf" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Acquiring lock "cinder-quobyte-f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-quobyte-f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Deleting offline snapshot f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 of volume 599f7f26-aec1-41be-a827-02a499a33edf {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] snapshot_file for this snap is: volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d34d0-6b41-4d06-8891-1292acf70b55]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:18 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" returned: 0 in 0.616s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:18 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 Apr 29 16:53:18 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16229439-4cdb-49df-b468-09950d33f44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493b8d6f-04f6-4a85-b635-d532eb42be06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:18 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Volume volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 (bd1c3906-294c-4eb1-9b8d-a12be0e7d481): created successfully Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493b8d6f-04f6-4a85-b635-d532eb42be06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Flow 'volume_create_manager' (e4e2003a-773d-4765-9520-74f0eaad843a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:18 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-2bc6943e-76f6-4d9e-908e-7d66d585d60a tempest-VolumesDeleteCascade-1534613731 None] Created volume successfully. Apr 29 16:53:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Creating offline snapshot 971caa0f-f627-4b5c-b45c-21cef8f17bec of volume bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:53:19 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7310b5-a01b-462b-9146-aafea6218c7b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:19 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46" returned: 0 in 0.750s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-599f7f26-aec1-41be-a827-02a499a33edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:53:19 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfabf0dd-2522-4051-9f3f-4f5cb772679a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:19 devstack sudo[92080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 Apr 29 16:53:19 devstack sudo[92080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:19 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf Apr 29 16:53:19 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:20 devstack sudo[92080]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" returned: 0 in 0.697s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:20 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec 1G Apr 29 16:53:20 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:20 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf" returned: 0 in 0.714s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:20 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 Apr 29 16:53:20 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:20 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec 1G" returned: 0 in 0.759s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:20 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec Apr 29 16:53:20 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:20 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46" returned: 0 in 0.674s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:20 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46 Apr 29 16:53:20 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:21 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec" returned: 0 in 0.640s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:21 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec is being set with open permissions: ugo+rw Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:21 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec Apr 29 16:53:21 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:21 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf.f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46" returned: 0 in 0.647s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-quobyte-f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46" released by "_delete_snapshot" :: held 2.895s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-quobyte-599f7f26-aec1-41be-a827-02a499a33edf" released by "delete_snapshot" :: held 2.916s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Created reservations ['0a1f2be3-a072-4c4d-aa7f-06109690af88', '29da2675-7087-4015-8a1b-a4922f4a3f44', '4f6994d0-1a78-4b49-a02f-ad037ba1e6a4', '2221219a-aeb5-43ff-8fb7-cc11c9e7dda7'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:21 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Delete snapshot completed successfully. Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-26a17fb5-4a20-4b9a-a38b-f99675e66924 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-f06a40cb-a7eb-44d5-ac8e-3cdfa1a2ca46-delete_snapshot" released by "delete_snapshot" :: held 3.042s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Acquiring lock "cinder-599f7f26-aec1-41be-a827-02a499a33edf-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-599f7f26-aec1-41be-a827-02a499a33edf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Acquiring lock "cinder-quobyte-599f7f26-aec1-41be-a827-02a499a33edf" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-quobyte-599f7f26-aec1-41be-a827-02a499a33edf" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:22 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d93ba5-b168-49cc-8bdd-d11d9a1889d1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:22 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf Apr 29 16:53:22 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:22 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec" returned: 0 in 0.607s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:22 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.info Apr 29 16:53:22 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:22 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf" returned: 0 in 0.691s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:22 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf Apr 29 16:53:22 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:22 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.info" returned: 0 in 0.591s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:22 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.info is being set with open permissions: ugo+rw Apr 29 16:53:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:22 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.info Apr 29 16:53:22 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:23 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-599f7f26-aec1-41be-a827-02a499a33edf" returned: 0 in 0.609s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-quobyte-599f7f26-aec1-41be-a827-02a499a33edf" released by "delete_volume" :: held 1.360s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:23 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.info" returned: 0 in 0.614s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.990s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:23 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-4da6ebfa-10f1-4207-b20f-2e46cd5a5c8a tempest-VolumesDeleteCascade-1534613731 None] Create snapshot completed successfully Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Created reservations ['4ae3eece-cde3-49d5-b3ba-7fe05f0a2025', '0bc56a06-fea7-4f54-abee-aac979283743', '8d453c9c-8c3c-4665-9619-38badc6ead71', '7f07b31e-dab0-4aef-9d22-255564ee011c'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:23 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:23 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:23 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Flow 'volume_create_manager' (f3989988-c1e1-4c25-b4ac-b5df03090e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498f41ad-89f1-4926-8af9-b4ae7c210718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498f41ad-89f1-4926-8af9-b4ae7c210718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1435913583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3644bb-dacf-458b-9044-5b8c18975a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d0ad43160e43a5804cc84dea7b31dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=971caa0f-f627-4b5c-b45c-21cef8f17bec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:24Z,use_quota=True,user_id='73672d65aa014fc68ce5dbabb0a7d692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5dcc45-7414-44c0-a1d8-bb3d36b3ff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5dcc45-7414-44c0-a1d8-bb3d36b3ff67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6db3586-af44-4117-8372-feb379416d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6db3586-af44-4117-8372-feb379416d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec3644bb-dacf-458b-9044-5b8c18975a43', 'volume_name': 'volume-ec3644bb-dacf-458b-9044-5b8c18975a43', 'volume_size': 1, 'snapshot_id': '971caa0f-f627-4b5c-b45c-21cef8f17bec'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba977341-8c99-4068-8f49-ca3c6e5c9a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba977341-8c99-4068-8f49-ca3c6e5c9a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47049f42-783f-4ac3-96c8-234c8b5f8503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:24 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Volume ec3644bb-dacf-458b-9044-5b8c18975a43: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec3644bb-dacf-458b-9044-5b8c18975a43', 'volume_size': 1, 'snapshot_id': '971caa0f-f627-4b5c-b45c-21cef8f17bec'} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-971caa0f-f627-4b5c-b45c-21cef8f17bec-ec3644bb-dacf-458b-9044-5b8c18975a43" by "_create_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:24 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.634s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-971caa0f-f627-4b5c-b45c-21cef8f17bec-ec3644bb-dacf-458b-9044-5b8c18975a43" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Creating volume ec3644bb-dacf-458b-9044-5b8c18975a43 from snapshot 971caa0f-f627-4b5c-b45c-21cef8f17bec {{(pid=84201) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-ec3644bb-dacf-458b-9044-5b8c18975a43" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:24 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Deleted volume successfully. Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-ec3644bb-dacf-458b-9044-5b8c18975a43" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] snapshot: 971caa0f-f627-4b5c-b45c-21cef8f17bec, volume: ec3644bb-dacf-458b-9044-5b8c18975a43, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-44f653ad-c900-458b-8f38-3221a0bbd1d9 tempest-VolumesSnapshotNegativeTestJSON-2128002123 None] Lock "cinder-599f7f26-aec1-41be-a827-02a499a33edf-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[582ea2e1-b568-4342-996c-6a7efe020a8d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:24 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec Apr 29 16:53:24 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:24 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec" returned: 0 in 0.749s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cb5d1d-506c-42c3-9a91-b9d6d46c0f94]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:25 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 Apr 29 16:53:25 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:25 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" returned: 0 in 0.749s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:25 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:53:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:25 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 Apr 29 16:53:25 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:27 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (fc3f71f3-081a-4976-a1f8-c0832a860f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ac1800-a630-492d-81bd-5d4a0b0016a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ac1800-a630-492d-81bd-5d4a0b0016a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1020461847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8426903-7526-4980-b511-40bb50751f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:28Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85743d09-7c41-4212-85ce-14dabf3ee59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85743d09-7c41-4212-85ce-14dabf3ee59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e197c520-73fa-4d83-abc1-d4edbbcd9c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e197c520-73fa-4d83-abc1-d4edbbcd9c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8426903-7526-4980-b511-40bb50751f93', 'volume_name': 'volume-b8426903-7526-4980-b511-40bb50751f93', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63b965b-7f0e-41e3-bd34-cfa7228881d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63b965b-7f0e-41e3-bd34-cfa7228881d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cba598-1099-4602-9567-043ca0377603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:28 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume b8426903-7526-4980-b511-40bb50751f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8426903-7526-4980-b511-40bb50751f93', 'volume_size': 1} Apr 29 16:53:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:30 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43" returned: 0 in 4.644s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:30 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f75f1eb-6c85-4ea5-84b6-ac283ea7882b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:30 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 Apr 29 16:53:30 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:31 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" returned: 0 in 0.837s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:53:31 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Converted 1024.00 MB image at 220.44 MB/s Apr 29 16:53:31 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 is being set with open permissions: ugo+rw Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:31 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 Apr 29 16:53:31 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:31 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43" returned: 0 in 0.580s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-ec3644bb-dacf-458b-9044-5b8c18975a43" released by "_copy_volume_from_snapshot" :: held 7.673s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-971caa0f-f627-4b5c-b45c-21cef8f17bec-ec3644bb-dacf-458b-9044-5b8c18975a43" released by "_create_volume_from_snapshot" :: held 7.709s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.730s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.716s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1020461847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8426903-7526-4980-b511-40bb50751f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:28Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Creating volume b8426903-7526-4980-b511-40bb50751f93 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:31 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=127,cinder:SELECT=106,cinder:INSERT=32,cinder:DELETE=15 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:53:31 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93 1073741824 Apr 29 16:53:31 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47049f42-783f-4ac3-96c8-234c8b5f8503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3644bb-dacf-458b-9044-5b8c18975a43', 'volume_size': 1, 'snapshot_id': '971caa0f-f627-4b5c-b45c-21cef8f17bec'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19634e5-4742-4672-9318-27be52b865bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:31 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Volume volume-ec3644bb-dacf-458b-9044-5b8c18975a43 (ec3644bb-dacf-458b-9044-5b8c18975a43): created successfully Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19634e5-4742-4672-9318-27be52b865bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Flow 'volume_create_manager' (f3989988-c1e1-4c25-b4ac-b5df03090e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:31 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-1b390355-226a-4a62-888e-c478b02f46b2 tempest-VolumesDeleteCascade-1534613731 None] Created volume successfully. Apr 29 16:53:32 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93 1073741824" returned: 0 in 0.746s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:32 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93 Apr 29 16:53:32 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-bd1c3906-294c-4eb1-9b8d-a12be0e7d481-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-bd1c3906-294c-4eb1-9b8d-a12be0e7d481-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Performing cascade delete. {{(pid=84201) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-971caa0f-f627-4b5c-b45c-21cef8f17bec-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-971caa0f-f627-4b5c-b45c-21cef8f17bec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-971caa0f-f627-4b5c-b45c-21cef8f17bec" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-971caa0f-f627-4b5c-b45c-21cef8f17bec" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Deleting offline snapshot 971caa0f-f627-4b5c-b45c-21cef8f17bec of volume bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] snapshot_file for this snap is: volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3529dff6-e1c6-4ee6-b982-65a8be7705a8]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:33 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec Apr 29 16:53:33 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:33 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93" returned: 0 in 0.599s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cba598-1099-4602-9567-043ca0377603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8426903-7526-4980-b511-40bb50751f93', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce602ec5-8aba-4b94-bf1b-f88bb2abc31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:33 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume volume-b8426903-7526-4980-b511-40bb50751f93 (b8426903-7526-4980-b511-40bb50751f93): created successfully Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce602ec5-8aba-4b94-bf1b-f88bb2abc31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (fc3f71f3-081a-4976-a1f8-c0832a860f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-82e2d2dc-3ac1-4f54-9034-1b0350c1e654 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created volume successfully. Apr 29 16:53:33 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec" returned: 0 in 0.729s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8894d773-b9c8-4b6e-98ea-d068f11781e4]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (76d0f376-b0c8-4959-a6f4-8ebb3cd98121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa963d02-ca20-4237-9b84-c37c4c59a382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:33 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 Apr 29 16:53:33 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa963d02-ca20-4237-9b84-c37c4c59a382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58293714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e8ed46-0a59-4748-a6c7-3725d4ed6d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:34Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da57b93-2710-43cd-af2f-1a03f21556bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da57b93-2710-43cd-af2f-1a03f21556bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738e4be5-6980-4cb2-837b-1aba44546f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738e4be5-6980-4cb2-837b-1aba44546f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e8ed46-0a59-4748-a6c7-3725d4ed6d1e', 'volume_name': 'volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9774fef8-102e-4273-be11-06d9a580c625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9774fef8-102e-4273-be11-06d9a580c625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e223d-c619-43ac-b24c-31b0d6016efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:33 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume 10e8ed46-0a59-4748-a6c7-3725d4ed6d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e', 'volume_size': 1} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58293714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e8ed46-0a59-4748-a6c7-3725d4ed6d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:34Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Creating volume 10e8ed46-0a59-4748-a6c7-3725d4ed6d1e {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:33 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:33 devstack sudo[92185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e 1073741824 Apr 29 16:53:33 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (75dbd17d-1e97-474e-9fd6-d4a68bcc15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e6f959-cc06-441f-99ed-647850cbff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e6f959-cc06-441f-99ed-647850cbff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346453937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1171fe-6522-41a2-a3bb-610d1623ef6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:34Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f54eb4-0916-462e-92aa-9db4e6cae20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f54eb4-0916-462e-92aa-9db4e6cae20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4be29c-2b76-4f51-91e1-c2d4f28267b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4be29c-2b76-4f51-91e1-c2d4f28267b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1171fe-6522-41a2-a3bb-610d1623ef6a', 'volume_name': 'volume-db1171fe-6522-41a2-a3bb-610d1623ef6a', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6256c7-cb95-4e23-9d0a-ec5b956e3a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6256c7-cb95-4e23-9d0a-ec5b956e3a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384e3c7f-0612-4fc1-8a40-84cd05833a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume db1171fe-6522-41a2-a3bb-610d1623ef6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1171fe-6522-41a2-a3bb-610d1623ef6a', 'volume_size': 1} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (5c0d835c-2fae-476a-93a6-150a0c3ccf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e5efeb-df1e-4e26-b587-acf8d542203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" returned: 0 in 0.924s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e5efeb-df1e-4e26-b587-acf8d542203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1401214878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0458480b-cf03-4fcd-b620-521694cad9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:35Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d63d72-1e6c-432c-83a4-5f7db4c20466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d63d72-1e6c-432c-83a4-5f7db4c20466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610827ad-96ea-4ad5-bc15-e3bcef91a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610827ad-96ea-4ad5-bc15-e3bcef91a710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0458480b-cf03-4fcd-b620-521694cad9a2', 'volume_name': 'volume-0458480b-cf03-4fcd-b620-521694cad9a2', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b6ffad-98a8-4412-99b0-2bcff426e400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b6ffad-98a8-4412-99b0-2bcff426e400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12af2592-dd18-4e42-b210-d29fbdafef7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume 0458480b-cf03-4fcd-b620-521694cad9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0458480b-cf03-4fcd-b620-521694cad9a2', 'volume_size': 1} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:34 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec Apr 29 16:53:34 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (00540ea0-b709-4e06-acc9-232363fd39f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:34 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0a289d-e2f4-451d-8cf1-decde331dfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e 1073741824" returned: 0 in 1.090s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:34 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0a289d-e2f4-451d-8cf1-decde331dfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938264442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffbd48d-fb03-4755-8ad3-e1236e82e8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:35Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068e338b-9cae-4d9f-a303-8c664719ed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068e338b-9cae-4d9f-a303-8c664719ed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274d44b6-a597-4c5e-b4c4-fedb1d3de8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274d44b6-a597-4c5e-b4c4-fedb1d3de8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ffbd48d-fb03-4755-8ad3-e1236e82e8b1', 'volume_name': 'volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d28bf75-3112-4d77-9fab-43d6b9f58344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d28bf75-3112-4d77-9fab-43d6b9f58344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188a1553-b25a-449f-bbef-459c3947a598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume 1ffbd48d-fb03-4755-8ad3-e1236e82e8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1', 'volume_size': 1} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:35 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e Apr 29 16:53:35 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (38743df0-9cd1-48bf-8c36-7a70dd6f1afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc73b7cf-55b1-485d-91cf-e64da77bbc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc73b7cf-55b1-485d-91cf-e64da77bbc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264528206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fabe3a-9efa-4888-a466-839de8c03980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:35Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a7afbb-27ec-4f0f-affe-6c839bddd32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a7afbb-27ec-4f0f-affe-6c839bddd32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1754a3-0ace-4623-bfba-774e07da99e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1754a3-0ace-4623-bfba-774e07da99e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38fabe3a-9efa-4888-a466-839de8c03980', 'volume_name': 'volume-38fabe3a-9efa-4888-a466-839de8c03980', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a56d50-dd4a-4c9f-af86-94ecd8d6ff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a56d50-dd4a-4c9f-af86-94ecd8d6ff9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f31044-46ff-44f7-8b45-e74c7429a3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume 38fabe3a-9efa-4888-a466-839de8c03980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38fabe3a-9efa-4888-a466-839de8c03980', 'volume_size': 1} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:35 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec" returned: 0 in 0.848s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:35 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec Apr 29 16:53:35 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:35 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e" returned: 0 in 0.649s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346453937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1171fe-6522-41a2-a3bb-610d1623ef6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:34Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Creating volume db1171fe-6522-41a2-a3bb-610d1623ef6a {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:35 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:35 devstack sudo[92205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a 1073741824 Apr 29 16:53:35 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e223d-c619-43ac-b24c-31b0d6016efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57df2b44-2f50-479d-bacc-ba57740291d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:35 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e (10e8ed46-0a59-4748-a6c7-3725d4ed6d1e): created successfully Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57df2b44-2f50-479d-bacc-ba57740291d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (76d0f376-b0c8-4959-a6f4-8ebb3cd98121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-be6fc2b0-0fc0-4e54-bf49-390dfcd0c381 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created volume successfully. Apr 29 16:53:36 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481.971caa0f-f627-4b5c-b45c-21cef8f17bec" returned: 0 in 0.608s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-971caa0f-f627-4b5c-b45c-21cef8f17bec" released by "_delete_snapshot" :: held 3.242s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" released by "delete_snapshot" :: held 3.264s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Created reservations ['08161a3e-182a-4f70-a017-07bfef8bc5ef', '9ba394b1-c81b-42eb-ba30-e687d7f29683', '522b0699-cc4b-45ec-9cd6-53d2fd1a58de', 'af6a19cc-0ffe-4a5a-8c17-38e96a8041ec'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:36 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Delete snapshot completed successfully. Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-971caa0f-f627-4b5c-b45c-21cef8f17bec-delete_snapshot" released by "delete_snapshot" :: held 3.405s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Snapshots deleted, issuing volume delete {{(pid=84201) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[88500af6-4a3c-4b4d-ab80-1e2389d84640]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:36 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 Apr 29 16:53:36 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:36 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a 1073741824" returned: 0 in 0.804s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:36 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a Apr 29 16:53:36 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:37 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" returned: 0 in 0.699s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:37 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481 Apr 29 16:53:37 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:37 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a" returned: 0 in 0.608s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.525s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1401214878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0458480b-cf03-4fcd-b620-521694cad9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:35Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Creating volume 0458480b-cf03-4fcd-b620-521694cad9a2 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:37 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384e3c7f-0612-4fc1-8a40-84cd05833a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1171fe-6522-41a2-a3bb-610d1623ef6a', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0909022-3725-423b-906f-847c976b099b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:37 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2 1073741824 Apr 29 16:53:37 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:37 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume volume-db1171fe-6522-41a2-a3bb-610d1623ef6a (db1171fe-6522-41a2-a3bb-610d1623ef6a): created successfully Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0909022-3725-423b-906f-847c976b099b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (75dbd17d-1e97-474e-9fd6-d4a68bcc15ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:37 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-a439d62f-b8dd-41f9-8960-3d83db14396e tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created volume successfully. Apr 29 16:53:37 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" returned: 0 in 0.624s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-bd1c3906-294c-4eb1-9b8d-a12be0e7d481" released by "delete_volume" :: held 1.386s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Created reservations ['22fee954-8041-469d-bd7f-a543d7053875', '3d372f33-52d5-45c0-b1a7-12cca530ff68', '1b2e478b-e735-4686-b7b6-e9a8d64bf3b9', '7d8c7bcb-82cc-4c2d-8ef2-3b0c93ae71fc'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:37 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:37 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:38 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2 1073741824" returned: 0 in 0.813s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:38 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2 Apr 29 16:53:38 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:38 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-ec3644bb-dacf-458b-9044-5b8c18975a43-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.637s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:38 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Deleted volume successfully. Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-ec3644bb-dacf-458b-9044-5b8c18975a43-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-11ed2ade-3ab1-4074-82f1-a38fa5ca79f6 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-bd1c3906-294c-4eb1-9b8d-a12be0e7d481-delete_volume" released by "delete_volume" :: held 5.676s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "cinder-quobyte-ec3644bb-dacf-458b-9044-5b8c18975a43" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-ec3644bb-dacf-458b-9044-5b8c18975a43" acquired by "delete_volume" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d437a7-69dc-474d-a970-89914906b3e7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:38 devstack sudo[92234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 Apr 29 16:53:38 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:38 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2" returned: 0 in 0.626s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.631s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938264442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffbd48d-fb03-4755-8ad3-e1236e82e8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:35Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Creating volume 1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:38 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:38 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 1073741824 Apr 29 16:53:38 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12af2592-dd18-4e42-b210-d29fbdafef7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0458480b-cf03-4fcd-b620-521694cad9a2', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90d266b-19b0-4fb5-b13a-117f57090861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:38 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume volume-0458480b-cf03-4fcd-b620-521694cad9a2 (0458480b-cf03-4fcd-b620-521694cad9a2): created successfully Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90d266b-19b0-4fb5-b13a-117f57090861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (5c0d835c-2fae-476a-93a6-150a0c3ccf52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:38 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-79193487-7274-4a3f-83db-5993e935974f tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created volume successfully. Apr 29 16:53:39 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43" returned: 0 in 0.754s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:39 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43 Apr 29 16:53:39 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:39 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 1073741824" returned: 0 in 0.803s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:39 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 Apr 29 16:53:39 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:39 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ec3644bb-dacf-458b-9044-5b8c18975a43" returned: 0 in 0.612s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-quobyte-ec3644bb-dacf-458b-9044-5b8c18975a43" released by "delete_volume" :: held 1.411s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:39 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Created reservations ['131d0f4f-ab80-490f-b047-55ca46a9b861', 'bb017c41-620d-4bdb-b425-3edbeb75dd52', '90868260-85b4-4b86-a766-92bb4577eb8b', '37b23f87-ec6b-49a9-8ba2-b09168e773fd'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:40 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:40 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:40 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1" returned: 0 in 0.628s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.746s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264528206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fabe3a-9efa-4888-a466-839de8c03980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722804f72d4f42348d6a9112dde4be39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:35Z,use_quota=True,user_id='2345d5834653425f983d32a77d74d039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Creating volume 38fabe3a-9efa-4888-a466-839de8c03980 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:40 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188a1553-b25a-449f-bbef-459c3947a598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:40 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980 1073741824 Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d666db9b-44b4-4653-98d8-668ba452356f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:40 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:40 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 (1ffbd48d-fb03-4755-8ad3-e1236e82e8b1): created successfully Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d666db9b-44b4-4653-98d8-668ba452356f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (00540ea0-b709-4e06-acc9-232363fd39f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:40 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ec6838c9-157a-47a7-9745-2aa57eeb219b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created volume successfully. Apr 29 16:53:40 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.606s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:40 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Deleted volume successfully. Apr 29 16:53:40 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee7e7eb6-8cfa-4f12-acda-02898e2584f0 tempest-VolumesDeleteCascade-1534613731 None] Lock "cinder-ec3644bb-dacf-458b-9044-5b8c18975a43-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:41 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980 1073741824" returned: 0 in 0.844s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:41 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980 Apr 29 16:53:41 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:41 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980" returned: 0 in 0.608s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f31044-46ff-44f7-8b45-e74c7429a3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38fabe3a-9efa-4888-a466-839de8c03980', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687abee9-6e98-4920-9fc4-93f45ef5d9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:41 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Volume volume-38fabe3a-9efa-4888-a466-839de8c03980 (38fabe3a-9efa-4888-a466-839de8c03980): created successfully Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687abee9-6e98-4920-9fc4-93f45ef5d9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Flow 'volume_create_manager' (38743df0-9cd1-48bf-8c36-7a70dd6f1afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:41 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-31227824-9a34-4cf3-bbcc-c9391cd13390 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created volume successfully. Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-38fabe3a-9efa-4888-a466-839de8c03980-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-38fabe3a-9efa-4888-a466-839de8c03980-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-quobyte-38fabe3a-9efa-4888-a466-839de8c03980" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-38fabe3a-9efa-4888-a466-839de8c03980" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:42 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a37984-6a39-4a86-a840-3e837576d69d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:42 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980 Apr 29 16:53:42 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:42 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980" returned: 0 in 0.720s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:42 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980 Apr 29 16:53:42 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:43 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-38fabe3a-9efa-4888-a466-839de8c03980" returned: 0 in 0.627s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-38fabe3a-9efa-4888-a466-839de8c03980" released by "delete_volume" :: held 1.392s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:43 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created reservations ['4af43ab2-15b0-499e-906d-c0c596639f69', '740ff37b-9588-4371-b257-84ca1cf482ad', 'ad43535a-4035-46de-bbd7-81b26c3a42ad', 'b609dd82-acf9-4751-9c31-2f952587d525'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:43 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:43 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:44 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.730s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:44 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:44 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Deleted volume successfully. Apr 29 16:53:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0adefb1c-e35c-4589-ab73-fd4cd145707b tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-38fabe3a-9efa-4888-a466-839de8c03980-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-quobyte-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:44 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ebd011-4b75-4f29-abe6-c9745a78590d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:44 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 Apr 29 16:53:44 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:45 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1" returned: 0 in 0.751s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:45 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1 Apr 29 16:53:45 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:45 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1" returned: 0 in 0.622s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1" released by "delete_volume" :: held 1.418s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created reservations ['0c8dca45-dcf0-4b7e-8b66-5472a08f3c2a', '92fa50c6-c173-45d7-ac50-85a7c618dac7', 'f838d105-4f6e-4ebd-a88d-4f36b8d6250c', 'd99ed431-4346-4e1f-8b4b-02006344d2c7'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:45 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:45 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:46 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-0458480b-cf03-4fcd-b620-521694cad9a2-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.609s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:46 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:46 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Deleted volume successfully. Apr 29 16:53:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-0458480b-cf03-4fcd-b620-521694cad9a2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-88625347-8753-4302-a092-2211d4fcc90c tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-1ffbd48d-fb03-4755-8ad3-e1236e82e8b1-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-quobyte-0458480b-cf03-4fcd-b620-521694cad9a2" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-0458480b-cf03-4fcd-b620-521694cad9a2" acquired by "delete_volume" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:46 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f39965-3f7e-4ec0-ac14-677057f02900]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:46 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2 Apr 29 16:53:46 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:47 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2" returned: 0 in 0.718s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:47 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2 Apr 29 16:53:47 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:48 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0458480b-cf03-4fcd-b620-521694cad9a2" returned: 0 in 0.770s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-0458480b-cf03-4fcd-b620-521694cad9a2" released by "delete_volume" :: held 1.532s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created reservations ['7c7acb82-2cc8-4e95-ab70-92cd9a24549d', '5ac9d3a6-8961-4a40-904d-606e52face66', '30f6a03f-53c9-4c8e-967d-42591584f5e1', 'a6f39633-d849-4ae3-9b3b-2549491d5b73'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:48 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:48 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-db1171fe-6522-41a2-a3bb-610d1623ef6a-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-db1171fe-6522-41a2-a3bb-610d1623ef6a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-quobyte-db1171fe-6522-41a2-a3bb-610d1623ef6a" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-db1171fe-6522-41a2-a3bb-610d1623ef6a" acquired by "delete_volume" :: waited 0.030s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:48 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.718s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:49 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:49 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Deleted volume successfully. Apr 29 16:53:49 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebda14e-48b6-4bf9-80b9-8ec1dc466f3b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-07aa891f-cfce-4d10-a1f4-799fbc28a887 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-0458480b-cf03-4fcd-b620-521694cad9a2-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:49 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a Apr 29 16:53:49 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:49 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a" returned: 0 in 0.757s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:49 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a Apr 29 16:53:49 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:50 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-db1171fe-6522-41a2-a3bb-610d1623ef6a" returned: 0 in 0.656s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-db1171fe-6522-41a2-a3bb-610d1623ef6a" released by "delete_volume" :: held 1.497s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:50 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created reservations ['d5c56228-dbba-4097-87e4-6d412dafb879', '75fe6e2b-d99f-4f06-a8f0-4314e2cd835b', 'f14d3af3-5aa9-4b62-bcd2-77b4717284f8', '6e78a123-68cd-4b24-bb02-14b46e149365'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:50 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:50 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:51 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.677s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:51 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:51 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Deleted volume successfully. Apr 29 16:53:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d860d084-d4ae-4f6d-94e6-4aa83e38b1b9 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-db1171fe-6522-41a2-a3bb-610d1623ef6a-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-quobyte-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:51 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3ba56b-2a24-4351-b5a1-1427aefd2d22]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:51 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e Apr 29 16:53:51 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:52 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e" returned: 0 in 0.767s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:52 devstack sudo[92316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e Apr 29 16:53:52 devstack sudo[92316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Flow 'volume_create_manager' (78ceb7b4-76e9-489d-b853-a6a313e2eaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55ff683-7a35-4faa-9f00-5a98a86109d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55ff683-7a35-4faa-9f00-5a98a86109d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900624841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd376fe-d44f-4ba5-a323-1c9d24c89e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c4f2736dc84a078958c3414f932ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:53Z,use_quota=True,user_id='f2c777615e0e4f43ae9408a46c78c8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737f5d02-0aaa-4830-b70c-8fba4c00f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737f5d02-0aaa-4830-b70c-8fba4c00f9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5e7b39-eb93-40c0-8d6d-f32d178e47b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5e7b39-eb93-40c0-8d6d-f32d178e47b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd376fe-d44f-4ba5-a323-1c9d24c89e18', 'volume_name': 'volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f640d1-6d3b-45ec-865c-44569509856a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f640d1-6d3b-45ec-865c-44569509856a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f4a6a5-aeb6-4c11-8987-e615b99e2714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:52 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Volume efd376fe-d44f-4ba5-a323-1c9d24c89e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18', 'volume_size': 1} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900624841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd376fe-d44f-4ba5-a323-1c9d24c89e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c4f2736dc84a078958c3414f932ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:53Z,use_quota=True,user_id='f2c777615e0e4f43ae9408a46c78c8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Creating volume efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:52 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:52 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 1073741824 Apr 29 16:53:52 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:52 devstack sudo[92316]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e" returned: 0 in 0.614s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e" released by "delete_volume" :: held 1.448s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created reservations ['8c3d0154-52ca-40b2-bc3d-6de1d29721ea', '199bc19a-9507-4585-b301-851f358f462e', '258edc2d-4eab-4d98-8ab1-635b0d142993', '41df35cf-2273-42b1-8368-d6705757ad4f'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:52 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:52 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-b8426903-7526-4980-b511-40bb50751f93-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-b8426903-7526-4980-b511-40bb50751f93-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:53 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.646s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "cinder-quobyte-b8426903-7526-4980-b511-40bb50751f93" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:53:53 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Deleted volume successfully. Apr 29 16:53:53 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 1073741824" returned: 0 in 0.831s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-b8426903-7526-4980-b511-40bb50751f93" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=165,cinder:SELECT=119,cinder:INSERT=42,cinder:DELETE=10 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c48b751c-4fda-4dbe-9b32-99cf34de0e91 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-10e8ed46-0a59-4748-a6c7-3725d4ed6d1e-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbd695b-90b6-4ad7-aec1-4e8bc68ba790]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:53 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 Apr 29 16:53:53 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:53 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93 Apr 29 16:53:53 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:54 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18" returned: 0 in 0.587s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f4a6a5-aeb6-4c11-8987-e615b99e2714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8344706c-6253-46fd-836d-cc196400d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:54 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Volume volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 (efd376fe-d44f-4ba5-a323-1c9d24c89e18): created successfully Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8344706c-6253-46fd-836d-cc196400d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Flow 'volume_create_manager' (78ceb7b4-76e9-489d-b853-a6a313e2eaa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:54 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8f30049a-65fd-4da2-b529-bcd09fed4766 tempest-VolumesActionsTest-970681568 None] Created volume successfully. Apr 29 16:53:54 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93" returned: 0 in 0.727s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:54 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93 Apr 29 16:53:54 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:54 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b8426903-7526-4980-b511-40bb50751f93" returned: 0 in 0.596s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-quobyte-b8426903-7526-4980-b511-40bb50751f93" released by "delete_volume" :: held 1.381s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:54 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Created reservations ['56551f16-0787-4965-9a70-dab577cd3e3e', 'e6461645-da6f-4eb0-aa93-8a4f2f5ff220', '652c1c02-df82-4764-834c-e1936f1d1a84', 'edeb96db-31f8-472b-b525-44510e93dbf7'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:53:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:55 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:53:55 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:55 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.656s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:55 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:53:55 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Deleted volume successfully. Apr 29 16:53:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-05157500-34ba-4c46-9b4a-2ac84f994e10 tempest-CreateVolumesFromSourceVolumeTest-47991905 None] Lock "cinder-b8426903-7526-4980-b511-40bb50751f93-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Flow 'volume_create_manager' (5a8579fc-e5d7-4f38-8fa9-7c9a56d559e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c9a020-a004-4af4-a05a-87e929211227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c9a020-a004-4af4-a05a-87e929211227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6d796f-5f3c-4839-8837-f0d40349e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9435700906654191912806d6585ac075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:59Z,use_quota=True,user_id='252d5222873b4ad98fd92a313d321eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23dacdeb-c59b-4746-9c9f-e44480ad7d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23dacdeb-c59b-4746-9c9f-e44480ad7d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98c73d5-6539-4ae4-a792-c0b7e665f0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98c73d5-6539-4ae4-a792-c0b7e665f0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6d796f-5f3c-4839-8837-f0d40349e0ec', 'volume_name': 'volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8f883a-64d7-433c-984a-79445918f0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8f883a-64d7-433c-984a-79445918f0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9056e199-8a35-4a94-9c21-b694cb6a21d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:53:58 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Volume 1d6d796f-5f3c-4839-8837-f0d40349e0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec', 'volume_size': 1} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6d796f-5f3c-4839-8837-f0d40349e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9435700906654191912806d6585ac075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:53:59Z,use_quota=True,user_id='252d5222873b4ad98fd92a313d321eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Creating volume 1d6d796f-5f3c-4839-8837-f0d40349e0ec {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:53:58 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:53:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:58 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec 1073741824 Apr 29 16:53:58 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:53:59 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Apr 29 16:53:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec 1073741824" returned: 0 in 0.789s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:53:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:53:59 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec Apr 29 16:53:59 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:00 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec" returned: 0 in 0.612s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:54:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:54:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9056e199-8a35-4a94-9c21-b694cb6a21d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:54:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a92338-054c-4465-bdf4-e45f4e8b912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:54:00 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Volume volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec (1d6d796f-5f3c-4839-8837-f0d40349e0ec): created successfully Apr 29 16:54:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a92338-054c-4465-bdf4-e45f4e8b912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:54:00 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Flow 'volume_create_manager' (5a8579fc-e5d7-4f38-8fa9-7c9a56d559e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:54:00 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-9f34af1f-e9e8-4c95-a464-a9a343408f3b tempest-CinderUnicodeTest-784773887 None] Created volume successfully. Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Flow 'volume_create_manager' (84d287a9-c0e9-49a1-b8c5-f9a8e7e99eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a1055c-c1c3-45ee-a2ef-b4ceb54680a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a1055c-c1c3-45ee-a2ef-b4ceb54680a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:54:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1669971022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bba79b-e52d-456e-b0cb-006bddd27caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9435700906654191912806d6585ac075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:54:01Z,use_quota=True,user_id='252d5222873b4ad98fd92a313d321eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f827e6b-c2ae-45ee-9c49-53bde6a0e49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f827e6b-c2ae-45ee-9c49-53bde6a0e49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f559fcfb-177e-49e9-a821-24881eb753fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f559fcfb-177e-49e9-a821-24881eb753fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3bba79b-e52d-456e-b0cb-006bddd27caa', 'volume_name': 'volume-b3bba79b-e52d-456e-b0cb-006bddd27caa', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97639ed6-74b2-46ce-976c-9bdc804d094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97639ed6-74b2-46ce-976c-9bdc804d094b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd52a007-658f-4c65-8f06-5f99a05c2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:54:01 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Volume b3bba79b-e52d-456e-b0cb-006bddd27caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3bba79b-e52d-456e-b0cb-006bddd27caa', 'volume_size': 1} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:54:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1669971022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bba79b-e52d-456e-b0cb-006bddd27caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9435700906654191912806d6585ac075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:54:01Z,use_quota=True,user_id='252d5222873b4ad98fd92a313d321eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Creating volume b3bba79b-e52d-456e-b0cb-006bddd27caa {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:54:01 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:54:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:01 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa 1073741824 Apr 29 16:54:01 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:02 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa 1073741824" returned: 0 in 0.897s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:02 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa Apr 29 16:54:02 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:02 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa" returned: 0 in 0.632s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:02 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:54:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:54:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd52a007-658f-4c65-8f06-5f99a05c2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3bba79b-e52d-456e-b0cb-006bddd27caa', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:54:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5856db5e-0949-49de-abc8-bab69b6406a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:54:02 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Volume volume-b3bba79b-e52d-456e-b0cb-006bddd27caa (b3bba79b-e52d-456e-b0cb-006bddd27caa): created successfully Apr 29 16:54:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5856db5e-0949-49de-abc8-bab69b6406a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:54:02 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Flow 'volume_create_manager' (84d287a9-c0e9-49a1-b8c5-f9a8e7e99eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:54:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-9b291f4e-3fa2-4e59-b9fe-b5519fb3c5b4 tempest-CinderUnicodeTest-784773887 None] Created volume successfully. Apr 29 16:54:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:54:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:54:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Creating offline snapshot 159e6542-f8fc-407d-a7bd-34014f094164 of volume b3bba79b-e52d-456e-b0cb-006bddd27caa {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:54:03 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dc1992-1041-4f0f-8596-c37a43864fe3]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:54:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:03 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa Apr 29 16:54:03 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:04 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa" returned: 0 in 0.728s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:04 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 1G Apr 29 16:54:04 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:54:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:54:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:54:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:54:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:54:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:54:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:04 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:54:04 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:05 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 1G" returned: 0 in 0.789s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3bba79b-e52d-456e-b0cb-006bddd27caa -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:05 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3bba79b-e52d-456e-b0cb-006bddd27caa -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 Apr 29 16:54:05 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:05 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.662s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:54:05 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3bba79b-e52d-456e-b0cb-006bddd27caa -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164" returned: 0 in 0.643s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:05 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 is being set with open permissions: ugo+rw Apr 29 16:54:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:05 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 Apr 29 16:54:05 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:06 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164" returned: 0 in 0.590s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:06 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.info Apr 29 16:54:06 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:07 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.info" returned: 0 in 0.596s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:07 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.info is being set with open permissions: ugo+rw Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:07 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.info Apr 29 16:54:07 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:07 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.info" returned: 0 in 0.573s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:54:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ab85d04e-dfb2-4b16-b85b-d81ce5ed507c tempest-CinderUnicodeTest-784773887 None] Create snapshot completed successfully Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Acquiring lock "cinder-159e6542-f8fc-407d-a7bd-34014f094164-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Lock "cinder-159e6542-f8fc-407d-a7bd-34014f094164-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Acquiring lock "cinder-quobyte-b3bba79b-e52d-456e-b0cb-006bddd27caa" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Lock "cinder-quobyte-b3bba79b-e52d-456e-b0cb-006bddd27caa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Acquiring lock "cinder-quobyte-159e6542-f8fc-407d-a7bd-34014f094164" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Lock "cinder-quobyte-159e6542-f8fc-407d-a7bd-34014f094164" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Deleting offline snapshot 159e6542-f8fc-407d-a7bd-34014f094164 of volume b3bba79b-e52d-456e-b0cb-006bddd27caa {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] snapshot_file for this snap is: volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[48698eba-802a-45cc-ab58-ce84239af826]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:54:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:08 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 Apr 29 16:54:08 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:09 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164" returned: 0 in 1.155s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:09 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3bba79b-e52d-456e-b0cb-006bddd27caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:54:09 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5ec815-3c6b-4b6a-81d1-44bead15e55e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:54:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:09 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa Apr 29 16:54:09 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:09 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa" returned: 0 in 0.816s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:09 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 Apr 29 16:54:09 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:10 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164" returned: 0 in 0.849s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:10 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164 Apr 29 16:54:10 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-56c78fca-1fdd-4d03-b644-9a2c22bcc42d tempest-VolumesActionsTest-970681568 None] Acquiring lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18" by "attach_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-56c78fca-1fdd-4d03-b644-9a2c22bcc42d tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18" acquired by "attach_volume" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-56c78fca-1fdd-4d03-b644-9a2c22bcc42d tempest-VolumesActionsTest-970681568 None] Attaching volume efd376fe-d44f-4ba5-a323-1c9d24c89e18 to instance ea42b4f5-0d2d-44c8-82c2-03e606eab763 at mountpoint /dev/vdb on host None. Apr 29 16:54:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-56c78fca-1fdd-4d03-b644-9a2c22bcc42d tempest-VolumesActionsTest-970681568 None] Attach volume completed successfully. Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-56c78fca-1fdd-4d03-b644-9a2c22bcc42d tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18" released by "attach_volume" :: held 0.139s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:11 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa.159e6542-f8fc-407d-a7bd-34014f094164" returned: 0 in 0.757s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Lock "cinder-quobyte-159e6542-f8fc-407d-a7bd-34014f094164" released by "_delete_snapshot" :: held 3.693s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Lock "cinder-quobyte-b3bba79b-e52d-456e-b0cb-006bddd27caa" released by "delete_snapshot" :: held 3.713s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Created reservations ['4c4a536d-4765-472f-b1d6-4019979cd62c', 'c931e5a3-2b69-4339-974e-2f6e2eecfc25', 'b54e041c-940a-459f-9e74-b85ed062d0af', '463a8947-3480-41bc-8ce1-135375f7201e'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:54:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Delete snapshot completed successfully. Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-def94bd8-36f9-4232-a0a4-55dd4135c9cc tempest-CinderUnicodeTest-784773887 None] Lock "cinder-159e6542-f8fc-407d-a7bd-34014f094164-delete_snapshot" released by "delete_snapshot" :: held 3.853s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-933fc69b-a6fd-414a-b361-9ffca9f86c16 tempest-VolumesActionsTest-970681568 None] Acquiring lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18-detach_volume" by "detach_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-933fc69b-a6fd-414a-b361-9ffca9f86c16 tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-933fc69b-a6fd-414a-b361-9ffca9f86c16 tempest-VolumesActionsTest-970681568 None] Detaching volume efd376fe-d44f-4ba5-a323-1c9d24c89e18 from instance ea42b4f5-0d2d-44c8-82c2-03e606eab763. Apr 29 16:54:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-933fc69b-a6fd-414a-b361-9ffca9f86c16 tempest-VolumesActionsTest-970681568 None] Detach volume completed successfully. Apr 29 16:54:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-933fc69b-a6fd-414a-b361-9ffca9f86c16 tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Acquiring lock "cinder-b3bba79b-e52d-456e-b0cb-006bddd27caa-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Lock "cinder-b3bba79b-e52d-456e-b0cb-006bddd27caa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Acquiring lock "cinder-quobyte-b3bba79b-e52d-456e-b0cb-006bddd27caa" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Lock "cinder-quobyte-b3bba79b-e52d-456e-b0cb-006bddd27caa" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:12 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3107e97-0a8c-4cd2-a774-ad5e684de2f1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:54:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:12 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa Apr 29 16:54:12 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:12 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa" returned: 0 in 0.790s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:13 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa Apr 29 16:54:13 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:13 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-b3bba79b-e52d-456e-b0cb-006bddd27caa" returned: 0 in 0.630s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Lock "cinder-quobyte-b3bba79b-e52d-456e-b0cb-006bddd27caa" released by "delete_volume" :: held 1.495s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:13 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Created reservations ['48d6fd25-339e-4e8b-9d77-691bb1957d3d', 'fb641ce8-e979-4e83-bfbb-20207a2845ae', 'd3b71f94-aa7b-4c95-bdc0-0b277f55ab0e', '5beea285-8309-4c90-81e5-e33b29da346d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:54:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:54:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:54:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:54:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:54:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:54:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:13 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:54:13 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Acquiring lock "cinder-1d6d796f-5f3c-4839-8837-f0d40349e0ec-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Lock "cinder-1d6d796f-5f3c-4839-8837-f0d40349e0ec-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Acquiring lock "cinder-quobyte-1d6d796f-5f3c-4839-8837-f0d40349e0ec" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Lock "cinder-quobyte-1d6d796f-5f3c-4839-8837-f0d40349e0ec" acquired by "delete_volume" :: waited 0.029s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:14 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eabbe69-3f28-4698-b6dd-977361c8f0e1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:54:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:14 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec Apr 29 16:54:14 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:14 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.947s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:14 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:54:14 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Deleted volume successfully. Apr 29 16:54:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-102b722a-8fef-4643-a141-4d919b134d2e tempest-CinderUnicodeTest-784773887 None] Lock "cinder-b3bba79b-e52d-456e-b0cb-006bddd27caa-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:15 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec" returned: 0 in 0.885s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:15 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec Apr 29 16:54:15 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:16 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1d6d796f-5f3c-4839-8837-f0d40349e0ec" returned: 0 in 0.656s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Lock "cinder-quobyte-1d6d796f-5f3c-4839-8837-f0d40349e0ec" released by "delete_volume" :: held 1.604s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Created reservations ['fc04ceec-3031-47cc-97d2-80282d99c257', 'c8273e24-db14-4bf7-9f0b-64db625c8b8d', '4ff05b9c-998f-40b2-816e-dc2a9338c953', '03ccce67-e5a7-41da-9efe-dc56b5ae9deb'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:16 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:54:16 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:16 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.612s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:54:16 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Deleted volume successfully. Apr 29 16:54:16 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-7bad8f1d-2777-4010-87a9-5b726e5798ae tempest-CinderUnicodeTest-784773887 None] Lock "cinder-1d6d796f-5f3c-4839-8837-f0d40349e0ec-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:26 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=121,cinder:SELECT=90,cinder:DELETE=7,cinder:INSERT=28 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:54:26 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=41,cinder:DELETE=7,cinder:SELECT=35,cinder:INSERT=12 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:54:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b479569e-6a3c-488e-b15d-a8a82dca9fbb tempest-VolumesActionsTest-970681568 None] Acquiring lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18" by "attach_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b479569e-6a3c-488e-b15d-a8a82dca9fbb tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18" acquired by "attach_volume" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b479569e-6a3c-488e-b15d-a8a82dca9fbb tempest-VolumesActionsTest-970681568 None] Attaching volume efd376fe-d44f-4ba5-a323-1c9d24c89e18 to instance 136d8af0-c8da-47e1-a96f-a54694d3508d at mountpoint /dev/vdb on host None. Apr 29 16:54:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b479569e-6a3c-488e-b15d-a8a82dca9fbb tempest-VolumesActionsTest-970681568 None] Attach volume completed successfully. Apr 29 16:54:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b479569e-6a3c-488e-b15d-a8a82dca9fbb tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18" released by "attach_volume" :: held 0.088s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1e711e1f-3d7c-43c9-aa1e-3d8e9a36e36f tempest-VolumesActionsTest-970681568 None] Acquiring lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18-detach_volume" by "detach_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:54:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1e711e1f-3d7c-43c9-aa1e-3d8e9a36e36f tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:54:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-1e711e1f-3d7c-43c9-aa1e-3d8e9a36e36f tempest-VolumesActionsTest-970681568 None] Detaching volume efd376fe-d44f-4ba5-a323-1c9d24c89e18 from instance 136d8af0-c8da-47e1-a96f-a54694d3508d. Apr 29 16:54:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-1e711e1f-3d7c-43c9-aa1e-3d8e9a36e36f tempest-VolumesActionsTest-970681568 None] Detach volume completed successfully. Apr 29 16:54:35 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-1e711e1f-3d7c-43c9-aa1e-3d8e9a36e36f tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:54:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:54:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:54:45 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c201754d-748b-4e27-8d58-03b86f10e9b3]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:54:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:45 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 Apr 29 16:54:45 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:45 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:54:45 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18" returned: 0 in 0.703s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:45 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4bea82-999f-4435-9751-aefd2268b58d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:54:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:46 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 Apr 29 16:54:46 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:46 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18" returned: 0 in 0.694s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.18fd2948-ec51-429b-ac4b-4b49124646fdn0a9pkg4.img {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:46 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.18fd2948-ec51-429b-ac4b-4b49124646fdn0a9pkg4.img Apr 29 16:54:46 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:50 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.18fd2948-ec51-429b-ac4b-4b49124646fdn0a9pkg4.img" returned: 0 in 4.089s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:50 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[64edb0de-f04c-474f-94db-b57d1db60a78]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:54:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:54:50 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 Apr 29 16:54:50 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:54:51 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Apr 29 16:54:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18" returned: 0 in 0.893s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:54:51 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.18fd2948-ec51-429b-ac4b-4b49124646fdn0a9pkg4.img {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:54:51 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Converted 1024.00 MB image at 250.32 MB/s Apr 29 16:54:51 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] 18fd2948-ec51-429b-ac4b-4b49124646fd was raw, no need to convert to raw {{(pid=84201) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 16:55:01 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=1 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:55:01 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:55:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:55:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:55:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:55:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:55:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:55:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:55:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:04 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:55:04 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:05 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.599s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:55:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.986s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:55:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Uploaded volume to glance image-id: 18fd2948-ec51-429b-ac4b-4b49124646fd. {{(pid=84201) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 16:55:10 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-2b52a466-705d-4a63-9ac1-de219186a1f2 tempest-VolumesActionsTest-970681568 None] Copy volume to image completed successfully. Apr 29 16:55:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:55:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:55:12 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[808d48f9-2413-4eec-acc4-e792b3c9badc]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:55:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:12 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 Apr 29 16:55:12 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:12 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18" returned: 0 in 0.683s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:12 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[11532ba3-647d-427f-84df-2c5ebed9b708]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:55:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:12 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 Apr 29 16:55:12 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:13 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18" returned: 0 in 0.704s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:13 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img Apr 29 16:55:13 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:17 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img" returned: 0 in 4.336s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:17 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed21f933-9bbb-4305-9201-57701135522a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:55:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:17 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 Apr 29 16:55:17 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:18 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18" returned: 0 in 0.868s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:18 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:55:18 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Converted 1024.00 MB image at 236.08 MB/s Apr 29 16:55:18 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] 6c59fff5-574f-44e1-971b-2473c514fdcf was raw, converting to qcow2 {{(pid=84201) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 16:55:18 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fc7d0d-8f64-4e6f-adf8-ec6846f024ef]: (4, 'raw') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:55:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:18 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img Apr 29 16:55:18 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:19 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img" returned: 0 in 0.674s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:19 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img Apr 29 16:55:19 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:20 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img" returned: 1 in 0.685s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img' failed. Not Retrying. {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:55:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img /opt/stack/data/cinder/conversion/vol_upload_tuyc2te0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:20 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img /opt/stack/data/cinder/conversion/vol_upload_tuyc2te0 Apr 29 16:55:20 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:20 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img /opt/stack/data/cinder/conversion/vol_upload_tuyc2te0" returned: 0 in 0.618s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:20 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Image conversion details: src /opt/stack/data/cinder/conversion/efd376fe-d44f-4ba5-a323-1c9d24c89e18.temp_image.6c59fff5-574f-44e1-971b-2473c514fdcfb508cluc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_tuyc2te0 {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:55:20 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 16:55:20 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[066f99bf-fc58-4bf2-9f01-22148f49f8d3]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:55:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tuyc2te0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:20 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tuyc2te0 Apr 29 16:55:20 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:21 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tuyc2te0" returned: 0 in 0.675s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:21 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=2 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:55:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.504s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:55:22 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Uploaded volume to glance image-id: 6c59fff5-574f-44e1-971b-2473c514fdcf. {{(pid=84201) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 16:55:22 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-fb83f726-a3ed-40ff-a898-acd710898497 tempest-VolumesActionsTest-970681568 None] Copy volume to image completed successfully. Apr 29 16:55:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Acquiring lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:55:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:55:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Acquiring lock "cinder-quobyte-efd376fe-d44f-4ba5-a323-1c9d24c89e18" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:55:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Lock "cinder-quobyte-efd376fe-d44f-4ba5-a323-1c9d24c89e18" acquired by "delete_volume" :: waited 0.012s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:55:24 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dc9f03-1f31-4beb-a8d5-1683d401af80]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:55:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:24 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 Apr 29 16:55:24 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:24 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18" returned: 0 in 0.698s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:24 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18 Apr 29 16:55:24 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:25 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-efd376fe-d44f-4ba5-a323-1c9d24c89e18" returned: 0 in 0.584s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Lock "cinder-quobyte-efd376fe-d44f-4ba5-a323-1c9d24c89e18" released by "delete_volume" :: held 1.320s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:55:25 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Created reservations ['134f6d58-f07b-4cb3-845c-4efc0686db2c', '6bacb953-53cb-42a6-a5fd-3c871c5d9d5c', '56ac67c1-23a9-49eb-9a5e-01b88f2cbb42', '9c8bc612-45f7-4b26-abd3-d01a4b5c29ac'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:55:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:55:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:55:25 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:55:25 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:55:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:55:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:25 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:55:25 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:26 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.569s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:26 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:55:26 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Deleted volume successfully. Apr 29 16:55:26 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f5b77f2b-2190-4473-a1fb-ee8ccc58ac78 tempest-VolumesActionsTest-970681568 None] Lock "cinder-efd376fe-d44f-4ba5-a323-1c9d24c89e18-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:55:35 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=12,cinder:SELECT=9,cinder:INSERT=1 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:55:36 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Flow 'volume_create_manager' (36935e27-be74-465c-9eb6-b60b54badea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d17303-bc02-43e6-b134-95c1d92dbc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d17303-bc02-43e6-b134-95c1d92dbc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1793906400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd145216-0747-4ecc-b6ac-50872bf7e8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e3c50da35648c0828d1070a67095be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:55:49Z,use_quota=True,user_id='5cfd028375084bde880133b217f41d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67c3adc-9539-463b-8935-63dac6ae294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67c3adc-9539-463b-8935-63dac6ae294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a049519-d0e2-4931-aae8-bb247d619638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a049519-d0e2-4931-aae8-bb247d619638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd145216-0747-4ecc-b6ac-50872bf7e8e3', 'volume_name': 'volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5381938-4a4a-41d5-b2e1-89ebe282f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5381938-4a4a-41d5-b2e1-89ebe282f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e1696a-f64e-4e57-b71c-2bfc7fb70dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:48 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Volume bd145216-0747-4ecc-b6ac-50872bf7e8e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3', 'volume_size': 1} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1793906400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd145216-0747-4ecc-b6ac-50872bf7e8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e3c50da35648c0828d1070a67095be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:55:49Z,use_quota=True,user_id='5cfd028375084bde880133b217f41d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Creating volume bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:55:48 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:55:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:49 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 1073741824 Apr 29 16:55:49 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:49 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 1073741824" returned: 0 in 0.765s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:49 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 Apr 29 16:55:49 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:50 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3" returned: 0 in 0.596s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:55:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:55:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e1696a-f64e-4e57-b71c-2bfc7fb70dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7918b9a-d39a-482a-b244-981233bca526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:50 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Volume volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 (bd145216-0747-4ecc-b6ac-50872bf7e8e3): created successfully Apr 29 16:55:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7918b9a-d39a-482a-b244-981233bca526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:50 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Flow 'volume_create_manager' (36935e27-be74-465c-9eb6-b60b54badea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:55:50 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-1fbe08ab-00e0-4891-99fd-c39f2d02b1ad tempest-SnapshotDependencyTests-691993300 None] Created volume successfully. Apr 29 16:55:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:55:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:55:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Creating offline snapshot 354be948-81a3-4a69-b1a9-b691e0308f02 of volume bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:55:51 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab7063b-89de-449a-a533-0da0f1255c2d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:55:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:51 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 Apr 29 16:55:51 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:51 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3" returned: 0 in 0.682s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:51 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 1G Apr 29 16:55:51 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:52 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 1G" returned: 0 in 0.724s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:52 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 Apr 29 16:55:52 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:53 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02" returned: 0 in 0.619s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:53 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 is being set with open permissions: ugo+rw Apr 29 16:55:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:53 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 Apr 29 16:55:53 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:53 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02" returned: 0 in 0.581s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:53 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.info Apr 29 16:55:53 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:54 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.info" returned: 0 in 0.581s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:54 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.info is being set with open permissions: ugo+rw Apr 29 16:55:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:54 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.info Apr 29 16:55:54 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:55 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.info" returned: 0 in 0.565s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.833s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:55:55 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-fc2e0caf-d50d-4a1c-be71-9640dd292301 tempest-SnapshotDependencyTests-691993300 None] Create snapshot completed successfully Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Flow 'volume_create_manager' (18dbf972-422a-43ca-b47b-e404c2bb88dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28a688e-1fc2-4609-ba1a-430a2411d7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28a688e-1fc2-4609-ba1a-430a2411d7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af48e7d5-4b00-4c76-956f-8e4f1b5af3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e3c50da35648c0828d1070a67095be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=354be948-81a3-4a69-b1a9-b691e0308f02,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:55:56Z,use_quota=True,user_id='5cfd028375084bde880133b217f41d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a829bb-c408-4ffa-b861-0de53a85f20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a829bb-c408-4ffa-b861-0de53a85f20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aad4da-2c11-4d3f-a577-0c4ca97763fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aad4da-2c11-4d3f-a577-0c4ca97763fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af48e7d5-4b00-4c76-956f-8e4f1b5af3a4', 'volume_name': 'volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4', 'volume_size': 1, 'snapshot_id': '354be948-81a3-4a69-b1a9-b691e0308f02'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c265b09-8b5b-46aa-977c-780fbbe52db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c265b09-8b5b-46aa-977c-780fbbe52db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e981d45d-d10c-4a80-bddc-4eca1e0bb63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:55:55 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Volume af48e7d5-4b00-4c76-956f-8e4f1b5af3a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4', 'volume_size': 1, 'snapshot_id': '354be948-81a3-4a69-b1a9-b691e0308f02'} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "cinder-quobyte-354be948-81a3-4a69-b1a9-b691e0308f02-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" by "_create_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-354be948-81a3-4a69-b1a9-b691e0308f02-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Creating volume af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 from snapshot 354be948-81a3-4a69-b1a9-b691e0308f02 {{(pid=84201) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "cinder-quobyte-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] snapshot: 354be948-81a3-4a69-b1a9-b691e0308f02, volume: af48e7d5-4b00-4c76-956f-8e4f1b5af3a4, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:55:55 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa19980a-e84e-406d-b9c7-23db57490842]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:55:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:56 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 Apr 29 16:55:56 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:56 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02" returned: 0 in 0.686s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:55:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:55:56 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:55:56 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a128c0a-b98c-4938-aa21-51f04935970b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:55:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:56 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 Apr 29 16:55:56 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:55:57 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Apr 29 16:55:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3" returned: 0 in 0.670s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:55:57 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:55:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:55:57 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 Apr 29 16:55:57 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:01 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" returned: 0 in 4.293s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:01 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df4ba5e-06bc-46cf-bb14-d0048b27ff34]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:01 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 Apr 29 16:56:01 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:02 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3" returned: 0 in 0.833s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:02 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:56:02 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Converted 1024.00 MB image at 238.47 MB/s Apr 29 16:56:02 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 is being set with open permissions: ugo+rw Apr 29 16:56:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:02 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 Apr 29 16:56:02 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:03 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" returned: 0 in 0.565s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" released by "_copy_volume_from_snapshot" :: held 7.131s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-354be948-81a3-4a69-b1a9-b691e0308f02-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" released by "_create_volume_from_snapshot" :: held 7.158s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.172s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e981d45d-d10c-4a80-bddc-4eca1e0bb63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4', 'volume_size': 1, 'snapshot_id': '354be948-81a3-4a69-b1a9-b691e0308f02'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa81c0cb-9134-4348-acdf-ae6186ec19b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:03 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Volume volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 (af48e7d5-4b00-4c76-956f-8e4f1b5af3a4): created successfully Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa81c0cb-9134-4348-acdf-ae6186ec19b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Flow 'volume_create_manager' (18dbf972-422a-43ca-b47b-e404c2bb88dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-bea7416f-9b62-4f9f-9b7f-74180f4d4943 tempest-SnapshotDependencyTests-691993300 None] Created volume successfully. Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "cinder-354be948-81a3-4a69-b1a9-b691e0308f02-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-354be948-81a3-4a69-b1a9-b691e0308f02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "cinder-quobyte-bd145216-0747-4ecc-b6ac-50872bf7e8e3" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-bd145216-0747-4ecc-b6ac-50872bf7e8e3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "cinder-quobyte-354be948-81a3-4a69-b1a9-b691e0308f02" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-354be948-81a3-4a69-b1a9-b691e0308f02" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Deleting offline snapshot 354be948-81a3-4a69-b1a9-b691e0308f02 of volume bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] snapshot_file for this snap is: volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeafaef-209c-4edb-8af2-49785e4b7ae7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:03 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 Apr 29 16:56:03 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:04 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02" returned: 0 in 0.683s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9a3752-8477-4495-985f-241ebccec676]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:04 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 Apr 29 16:56:04 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:04 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:56:04 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:05 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3" returned: 0 in 0.689s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:05 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 Apr 29 16:56:05 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:05 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.576s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:56:05 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02" returned: 0 in 0.685s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:05 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02 Apr 29 16:56:05 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:06 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3.354be948-81a3-4a69-b1a9-b691e0308f02" returned: 0 in 0.593s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-354be948-81a3-4a69-b1a9-b691e0308f02" released by "_delete_snapshot" :: held 2.741s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-bd145216-0747-4ecc-b6ac-50872bf7e8e3" released by "delete_snapshot" :: held 2.761s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Created reservations ['ae943a7d-cff2-4684-9f1d-14feb3b6cb15', '557e36b3-747f-417d-8f49-9655b03c3240', '33aece23-c6e4-4e5c-9b96-516d0686d1cf', '77231fe4-6faf-4945-b12b-317c0b21c83a'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:56:06 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Delete snapshot completed successfully. Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8dee725e-a0f1-478c-96af-30e80b77fd6d tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-354be948-81a3-4a69-b1a9-b691e0308f02-delete_snapshot" released by "delete_snapshot" :: held 2.889s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "cinder-bd145216-0747-4ecc-b6ac-50872bf7e8e3-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-bd145216-0747-4ecc-b6ac-50872bf7e8e3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "cinder-quobyte-bd145216-0747-4ecc-b6ac-50872bf7e8e3" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-bd145216-0747-4ecc-b6ac-50872bf7e8e3" acquired by "delete_volume" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f026f5-2439-46ad-a0ad-ccb68be910b7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:06 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 Apr 29 16:56:06 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:07 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3" returned: 0 in 0.735s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:07 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3 Apr 29 16:56:07 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:08 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-bd145216-0747-4ecc-b6ac-50872bf7e8e3" returned: 0 in 0.618s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-bd145216-0747-4ecc-b6ac-50872bf7e8e3" released by "delete_volume" :: held 1.409s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Created reservations ['ff8f0123-1b50-455e-8163-55596af5ff4f', 'b8b95ef5-b24c-4a46-8865-8c9fc41fa25c', '8cc95640-26da-4957-89a7-f12ab33a7297', '128cc6bb-045e-4e91-9d76-177edf012885'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:08 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:56:08 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:08 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.594s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:56:08 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Deleted volume successfully. Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "cinder-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3cb2f629-21f7-421d-bf29-6e98a95799f8 tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-bd145216-0747-4ecc-b6ac-50872bf7e8e3-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "cinder-quobyte-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:09 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" acquired by "delete_volume" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:09 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da16e2-b559-4c08-80fc-3dd4aaf60b79]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:09 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 Apr 29 16:56:09 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:09 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" returned: 0 in 0.725s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:09 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4 Apr 29 16:56:09 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:10 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" returned: 0 in 0.619s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-quobyte-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4" released by "delete_volume" :: held 1.403s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:10 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Created reservations ['5c3890ad-3ecc-4b43-bb7d-b8f196827686', '6503e47a-6671-4402-a3e2-5baa0afda0e6', 'f24258b6-9c35-470e-8d40-ad685d244c34', '35a52910-41e5-4e37-a36e-a5ff8b424c6b'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:56:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:10 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:56:10 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:11 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.624s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:11 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:56:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Deleted volume successfully. Apr 29 16:56:11 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-72dfd707-425e-42ae-aff6-a11b50aa34ec tempest-SnapshotDependencyTests-691993300 None] Lock "cinder-af48e7d5-4b00-4c76-956f-8e4f1b5af3a4-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:20 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=9 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:56:21 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Flow 'volume_create_manager' (5e9c6ee6-0b03-46f5-b2dc-cf68dc3765d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db199468-9a26-4442-9bc6-d03fd2cf8c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db199468-9a26-4442-9bc6-d03fd2cf8c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-996424456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbd48c3-ec83-40ee-9e3a-755005700ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d6513fb734549a7c247c3ad3ffce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:29Z,use_quota=True,user_id='646c935b987d44c5b74092f84b798bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5c0896-30a9-4d00-a327-e52fa70baab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5c0896-30a9-4d00-a327-e52fa70baab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeb4e65-deb0-431c-89be-0c6bcc138fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeb4e65-deb0-431c-89be-0c6bcc138fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dbd48c3-ec83-40ee-9e3a-755005700ca5', 'volume_name': 'volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554cda07-efb6-43d1-a2b3-46641b4d1cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554cda07-efb6-43d1-a2b3-46641b4d1cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da5b803-51f5-476f-ab7d-085b49c74655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Volume 1dbd48c3-ec83-40ee-9e3a-755005700ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5', 'volume_size': 1} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-996424456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbd48c3-ec83-40ee-9e3a-755005700ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d6513fb734549a7c247c3ad3ffce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:29Z,use_quota=True,user_id='646c935b987d44c5b74092f84b798bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Creating volume 1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:29 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:29 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 1073741824 Apr 29 16:56:29 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Flow 'volume_create_manager' (d2194eb1-7932-417e-95ce-2c23ac38ef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2440db6-a1db-4ef2-87ec-6ae4788af77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2440db6-a1db-4ef2-87ec-6ae4788af77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054b96b9-75a7-412c-8e2d-7572bc492a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78caf30498d4344a8bb9b6e2c3cb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:29Z,use_quota=True,user_id='0279f81569af4d39b662a77c95738c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8716b568-d482-4014-b0e1-0c61b0a32f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8716b568-d482-4014-b0e1-0c61b0a32f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ae3958-01a3-4f40-a4da-2c635bbc7af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ae3958-01a3-4f40-a4da-2c635bbc7af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054b96b9-75a7-412c-8e2d-7572bc492a73', 'volume_name': 'volume-054b96b9-75a7-412c-8e2d-7572bc492a73', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcd3cd6-efb7-4364-bda3-2f003bddd93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcd3cd6-efb7-4364-bda3-2f003bddd93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babeec02-d977-4b9f-9610-901bd3314e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Volume 054b96b9-75a7-412c-8e2d-7572bc492a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054b96b9-75a7-412c-8e2d-7572bc492a73', 'volume_size': 1} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (69f709a8-d9f8-4022-a8b7-927f78092380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ce7588-b849-4a38-bde4-a2d0938596e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ce7588-b849-4a38-bde4-a2d0938596e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771023506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:30Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3903d806-66aa-442a-b276-2d13f2569a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3903d806-66aa-442a-b276-2d13f2569a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94551e6-1063-4cbe-b7a4-7d46e27e6809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94551e6-1063-4cbe-b7a4-7d46e27e6809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27', 'volume_name': 'volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670b23c0-d2a8-4edd-9a0c-70fa3af806e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670b23c0-d2a8-4edd-9a0c-70fa3af806e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef52932b-2ce1-4706-8c75-5dad553d62f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Volume 13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27', 'volume_size': 1} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (8fc9d063-bf21-45e0-858c-9455bb26ab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c842feb1-b299-41aa-9bae-1600e889244c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c842feb1-b299-41aa-9bae-1600e889244c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722849712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79f949f-de2e-4255-b87b-e5aa96dec93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:30Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6364d888-e171-4674-b8d9-72a490aca819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6364d888-e171-4674-b8d9-72a490aca819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dd39dd-5fe7-4205-986c-93fdc6d26a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dd39dd-5fe7-4205-986c-93fdc6d26a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79f949f-de2e-4255-b87b-e5aa96dec93c', 'volume_name': 'volume-f79f949f-de2e-4255-b87b-e5aa96dec93c', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f85e81-7ab7-4bd1-ba27-8d878e9ef354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f85e81-7ab7-4bd1-ba27-8d878e9ef354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa58cdff-b51a-4508-b040-047243fe2ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:29 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume f79f949f-de2e-4255-b87b-e5aa96dec93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79f949f-de2e-4255-b87b-e5aa96dec93c', 'volume_size': 1} Apr 29 16:56:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (e1eb4e17-7084-4c08-9581-109a2d9f6694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b48e09e-1856-4f63-93d9-5b42c9c6ce6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b48e09e-1856-4f63-93d9-5b42c9c6ce6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1700535655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5815fe38-d75e-4937-9013-bb3da342d5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:30Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c1c501-1ecb-4413-80e6-77b9200f178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c1c501-1ecb-4413-80e6-77b9200f178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2996514-d9b7-4ff6-a4fe-3bbcdcd6d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2996514-d9b7-4ff6-a4fe-3bbcdcd6d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5815fe38-d75e-4937-9013-bb3da342d5a9', 'volume_name': 'volume-5815fe38-d75e-4937-9013-bb3da342d5a9', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0175768-991b-4135-8503-551a2d83a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0175768-991b-4135-8503-551a2d83a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ca3f51-79a5-468c-b558-bb1bb2bf7680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Volume 5815fe38-d75e-4937-9013-bb3da342d5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5815fe38-d75e-4937-9013-bb3da342d5a9', 'volume_size': 1} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:30 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 1073741824" returned: 0 in 0.901s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:30 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 Apr 29 16:56:30 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (fe9b9a65-f2cc-4635-8acb-0cd951de01eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2967b4-bfac-43d1-8f14-555a13271f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2967b4-bfac-43d1-8f14-555a13271f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-95296228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad130703-1a04-40db-8d3d-142f6a2e5a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:30Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7946d93-d811-4065-85f4-bd1a787686cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7946d93-d811-4065-85f4-bd1a787686cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d955da-9a63-4b43-94ff-491e24a96869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d955da-9a63-4b43-94ff-491e24a96869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad130703-1a04-40db-8d3d-142f6a2e5a56', 'volume_name': 'volume-ad130703-1a04-40db-8d3d-142f6a2e5a56', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b74043-05ac-40f3-992f-610bdf78d4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b74043-05ac-40f3-992f-610bdf78d4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2a49ea-d377-4d40-91db-90d91e242f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Volume ad130703-1a04-40db-8d3d-142f6a2e5a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad130703-1a04-40db-8d3d-142f6a2e5a56', 'volume_size': 1} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:30 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (455ec76f-c5bd-4af1-833d-3e0ad02ef95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8856af70-36e0-4794-b6d6-3ce778c29eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5" returned: 0 in 0.630s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054b96b9-75a7-412c-8e2d-7572bc492a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78caf30498d4344a8bb9b6e2c3cb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:29Z,use_quota=True,user_id='0279f81569af4d39b662a77c95738c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Creating volume 054b96b9-75a7-412c-8e2d-7572bc492a73 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:30 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8856af70-36e0-4794-b6d6-3ce778c29eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-669808963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ae0739-b384-4ed3-b369-4af010630e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:31Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73 1073741824 Apr 29 16:56:30 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c68d3a-e373-4328-af99-7b803d4f0cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c68d3a-e373-4328-af99-7b803d4f0cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeb6027-4c0e-4e96-832b-3b26a3e2059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeb6027-4c0e-4e96-832b-3b26a3e2059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ae0739-b384-4ed3-b369-4af010630e25', 'volume_name': 'volume-90ae0739-b384-4ed3-b369-4af010630e25', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c86e3b0-7990-43c7-8397-e3f9e1700f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c86e3b0-7990-43c7-8397-e3f9e1700f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c28fd9c-274b-4124-987d-94e7862a8541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Volume 90ae0739-b384-4ed3-b369-4af010630e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ae0739-b384-4ed3-b369-4af010630e25', 'volume_size': 1} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da5b803-51f5-476f-ab7d-085b49c74655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ace2a53-6d3a-4dd1-85a7-e7de49a398a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:30 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Volume volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 (1dbd48c3-ec83-40ee-9e3a-755005700ca5): created successfully Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ace2a53-6d3a-4dd1-85a7-e7de49a398a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:30 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Flow 'volume_create_manager' (5e9c6ee6-0b03-46f5-b2dc-cf68dc3765d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:30 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7432c9bd-2166-4312-9d24-88a9923481fa tempest-VolumeDependencyTests-1993145891 None] Created volume successfully. Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (f4e0e577-b3d2-452b-9ee9-781321e9c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a636d3c5-c748-476f-aac2-ee7b1ca7f5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a636d3c5-c748-476f-aac2-ee7b1ca7f5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926600336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001c64b2-81bb-4e84-9a3e-4f2811c20cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:31Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad6f849-d495-4b75-9792-d4016c4dbf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad6f849-d495-4b75-9792-d4016c4dbf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e877683-f28b-43ac-8a7a-acec173d86c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e877683-f28b-43ac-8a7a-acec173d86c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001c64b2-81bb-4e84-9a3e-4f2811c20cbe', 'volume_name': 'volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95e5bc4-88fb-4c8a-88d5-9a0d0d17393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95e5bc4-88fb-4c8a-88d5-9a0d0d17393b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003641ce-ea34-44d5-b331-37ad746f8522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:31 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Volume 001c64b2-81bb-4e84-9a3e-4f2811c20cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe', 'volume_size': 1} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:31 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73 1073741824" returned: 0 in 0.813s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:31 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73 Apr 29 16:56:31 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:32 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73" returned: 0 in 0.610s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.510s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771023506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:30Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Creating volume 13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:32 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babeec02-d977-4b9f-9610-901bd3314e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054b96b9-75a7-412c-8e2d-7572bc492a73', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:32 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 1073741824 Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbc095c-81fd-4eba-8336-002a95d4986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:32 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:32 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Volume volume-054b96b9-75a7-412c-8e2d-7572bc492a73 (054b96b9-75a7-412c-8e2d-7572bc492a73): created successfully Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbc095c-81fd-4eba-8336-002a95d4986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:32 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Flow 'volume_create_manager' (d2194eb1-7932-417e-95ce-2c23ac38ef3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:32 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-4fc64567-4ff4-4be6-9f20-6249dffc08f8 tempest-CinderUnicodeTest-2099095157 None] Created volume successfully. Apr 29 16:56:33 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 1073741824" returned: 0 in 0.794s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:33 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 Apr 29 16:56:33 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Flow 'volume_create_manager' (e97a0ca8-8daf-4d9f-a822-c1a864825fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72f9789-a0dd-49da-8ff6-3eacdc11b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72f9789-a0dd-49da-8ff6-3eacdc11b484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-504132801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2038e95-de1a-4749-9091-3bab46fcec62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78caf30498d4344a8bb9b6e2c3cb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:33Z,use_quota=True,user_id='0279f81569af4d39b662a77c95738c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acb6b4c-0100-4d66-83b6-81d08566221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acb6b4c-0100-4d66-83b6-81d08566221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8125c757-0f69-42ed-b7da-e3aa0ce94441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8125c757-0f69-42ed-b7da-e3aa0ce94441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2038e95-de1a-4749-9091-3bab46fcec62', 'volume_name': 'volume-d2038e95-de1a-4749-9091-3bab46fcec62', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bb0316-6241-4ed4-a361-c9d3bb42b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bb0316-6241-4ed4-a361-c9d3bb42b435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2503821e-7377-40a5-82fc-c23800eba182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:33 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Volume d2038e95-de1a-4749-9091-3bab46fcec62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2038e95-de1a-4749-9091-3bab46fcec62', 'volume_size': 1} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:33 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27" returned: 0 in 0.593s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.844s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722849712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79f949f-de2e-4255-b87b-e5aa96dec93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:30Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Creating volume f79f949f-de2e-4255-b87b-e5aa96dec93c {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:33 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef52932b-2ce1-4706-8c75-5dad553d62f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:33 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c 1073741824 Apr 29 16:56:33 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49ad669-ea3b-4d0c-b84f-f7e13b292248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:33 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Volume volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 (13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27): created successfully Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49ad669-ea3b-4d0c-b84f-f7e13b292248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:33 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (69f709a8-d9f8-4022-a8b7-927f78092380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:33 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-a35dff6e-f50f-4000-9b38-f45f627b6ee6 tempest-CreateVolumesFromImageTest-1578243594 None] Created volume successfully. Apr 29 16:56:34 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c 1073741824" returned: 0 in 0.762s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:34 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c Apr 29 16:56:34 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:35 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c" returned: 0 in 0.591s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.021s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1700535655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5815fe38-d75e-4937-9013-bb3da342d5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:30Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Creating volume 5815fe38-d75e-4937-9013-bb3da342d5a9 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:35 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:35 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9 1073741824 Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa58cdff-b51a-4508-b040-047243fe2ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79f949f-de2e-4255-b87b-e5aa96dec93c', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:35 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d9b028-bea5-4223-94f5-97c98e0fb703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:35 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume volume-f79f949f-de2e-4255-b87b-e5aa96dec93c (f79f949f-de2e-4255-b87b-e5aa96dec93c): created successfully Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d9b028-bea5-4223-94f5-97c98e0fb703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (8fc9d063-bf21-45e0-858c-9455bb26ab1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:35 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-7b78127f-05fd-4bf9-9c38-786f1ee45ecc tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created volume successfully. Apr 29 16:56:35 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9 1073741824" returned: 0 in 0.782s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:35 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9 Apr 29 16:56:35 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:36 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9" returned: 0 in 0.634s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.123s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-95296228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad130703-1a04-40db-8d3d-142f6a2e5a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:30Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Creating volume ad130703-1a04-40db-8d3d-142f6a2e5a56 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:36 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:36 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 1073741824 Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ca3f51-79a5-468c-b558-bb1bb2bf7680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5815fe38-d75e-4937-9013-bb3da342d5a9', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:36 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b880b7d-ef64-4cf9-8ad6-bc12556fd2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:36 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Volume volume-5815fe38-d75e-4937-9013-bb3da342d5a9 (5815fe38-d75e-4937-9013-bb3da342d5a9): created successfully Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b880b7d-ef64-4cf9-8ad6-bc12556fd2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:36 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (e1eb4e17-7084-4c08-9581-109a2d9f6694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:36 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0417a375-d0cf-425d-9273-79116fed79ec tempest-CreateVolumesFromImageTest-1578243594 None] Created volume successfully. Apr 29 16:56:37 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 1073741824" returned: 0 in 0.796s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:37 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 Apr 29 16:56:37 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:37 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56" returned: 0 in 0.580s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.115s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-669808963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ae0739-b384-4ed3-b369-4af010630e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:31Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Creating volume 90ae0739-b384-4ed3-b369-4af010630e25 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:37 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:56:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:38 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25 1073741824 Apr 29 16:56:38 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2a49ea-d377-4d40-91db-90d91e242f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad130703-1a04-40db-8d3d-142f6a2e5a56', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be347446-90ee-4c62-8bff-e14f345cb652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:38 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Volume volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 (ad130703-1a04-40db-8d3d-142f6a2e5a56): created successfully Apr 29 16:56:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be347446-90ee-4c62-8bff-e14f345cb652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:38 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (fe9b9a65-f2cc-4635-8acb-0cd951de01eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:38 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-38deb9f0-158c-4558-8534-c412154f8d59 tempest-CreateVolumesFromImageTest-1578243594 None] Created volume successfully. Apr 29 16:56:38 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25 1073741824" returned: 0 in 0.797s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:38 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25 Apr 29 16:56:38 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:39 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25" returned: 0 in 0.601s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.270s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926600336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001c64b2-81bb-4e84-9a3e-4f2811c20cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c93f1abe2e4db995ff8d3532e2b2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:31Z,use_quota=True,user_id='61caa80f6f5e4426a9e81f9b49756169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Creating volume 001c64b2-81bb-4e84-9a3e-4f2811c20cbe {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:39 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c28fd9c-274b-4124-987d-94e7862a8541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ae0739-b384-4ed3-b369-4af010630e25', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:39 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe 1073741824 Apr 29 16:56:39 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1cdc72-52aa-4baa-940e-366e8662d55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:39 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Volume volume-90ae0739-b384-4ed3-b369-4af010630e25 (90ae0739-b384-4ed3-b369-4af010630e25): created successfully Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1cdc72-52aa-4baa-940e-366e8662d55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (455ec76f-c5bd-4af1-833d-3e0ad02ef95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:39 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-dc8a442e-f981-4ef0-ac32-efaa50652528 tempest-CreateVolumesFromImageTest-1578243594 None] Created volume successfully. Apr 29 16:56:40 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe 1073741824" returned: 0 in 0.794s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:40 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe Apr 29 16:56:40 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:40 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe" returned: 0 in 0.609s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.884s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003641ce-ea34-44d5-b331-37ad746f8522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40d3cf9-20c9-4811-8598-61ac5d533dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Creating offline snapshot ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 of volume 1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:56:40 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Volume volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe (001c64b2-81bb-4e84-9a3e-4f2811c20cbe): created successfully Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40d3cf9-20c9-4811-8598-61ac5d533dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Flow 'volume_create_manager' (f4e0e577-b3d2-452b-9ee9-781321e9c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f25161-11f4-4269-afa2-ad40f69b63f2]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:40 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-913c2c18-9b7b-46b0-ae0d-2ed911814034 tempest-CreateVolumesFromImageTest-1578243594 None] Created volume successfully. Apr 29 16:56:41 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 Apr 29 16:56:41 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:41 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5" returned: 0 in 0.730s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:41 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 1G Apr 29 16:56:41 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-001c64b2-81bb-4e84-9a3e-4f2811c20cbe-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-001c64b2-81bb-4e84-9a3e-4f2811c20cbe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-quobyte-001c64b2-81bb-4e84-9a3e-4f2811c20cbe" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-001c64b2-81bb-4e84-9a3e-4f2811c20cbe" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:42 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d458e66b-c5a4-445b-86b9-4f02b268bb65]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:42 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe Apr 29 16:56:42 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:42 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 1G" returned: 0 in 0.801s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:42 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 Apr 29 16:56:42 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:42 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe" returned: 0 in 0.768s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:42 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe Apr 29 16:56:42 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:43 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26" returned: 0 in 0.687s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:43 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 is being set with open permissions: ugo+rw Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:43 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 Apr 29 16:56:43 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:43 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-001c64b2-81bb-4e84-9a3e-4f2811c20cbe" returned: 0 in 0.639s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-001c64b2-81bb-4e84-9a3e-4f2811c20cbe" released by "delete_volume" :: held 1.446s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Created reservations ['a480a2f9-e60f-4b84-b4be-ca129557ebd6', 'ed32e9bc-5dc3-468c-9eb4-a951b1db7ebc', 'e7385a6c-a827-4cee-a58d-192e5497ce07', '1cd3e716-5d7d-4f98-952b-ea945a00df65'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:43 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:56:43 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:43 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26" returned: 0 in 0.610s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:43 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.info Apr 29 16:56:43 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-90ae0739-b384-4ed3-b369-4af010630e25-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-90ae0739-b384-4ed3-b369-4af010630e25-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:44 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.645s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:56:44 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Deleted volume successfully. Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-quobyte-90ae0739-b384-4ed3-b369-4af010630e25" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-a6ebb85f-ea67-4ac8-b8b4-e83b713ffcc4 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-001c64b2-81bb-4e84-9a3e-4f2811c20cbe-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-90ae0739-b384-4ed3-b369-4af010630e25" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2e8083-c2b2-471c-981f-e970596aded6]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:44 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25 Apr 29 16:56:44 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:44 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.info" returned: 0 in 0.625s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:44 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.info is being set with open permissions: ugo+rw Apr 29 16:56:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:44 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.info Apr 29 16:56:44 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:45 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25" returned: 0 in 0.713s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:45 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25 Apr 29 16:56:45 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:45 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.info" returned: 0 in 0.611s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.173s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.749s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-504132801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2038e95-de1a-4749-9091-3bab46fcec62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78caf30498d4344a8bb9b6e2c3cb097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:33Z,use_quota=True,user_id='0279f81569af4d39b662a77c95738c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Creating volume d2038e95-de1a-4749-9091-3bab46fcec62 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:45 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:45 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 1073741824 Apr 29 16:56:45 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:45 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-af189087-6359-478d-809d-84bb35cc0bca tempest-VolumeDependencyTests-1993145891 None] Create snapshot completed successfully Apr 29 16:56:45 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-90ae0739-b384-4ed3-b369-4af010630e25" returned: 0 in 0.662s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-90ae0739-b384-4ed3-b369-4af010630e25" released by "delete_volume" :: held 1.418s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Created reservations ['88fcf961-da90-4e08-ac65-6d0f896e315f', 'fded327a-f0f5-4310-9db8-c2d29c02fed0', '8987e166-da70-42c0-95b3-a9906d5872f9', 'b5904921-03ba-40f4-9d64-0f86f4786273'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Flow 'volume_create_manager' (6e581815-5cca-4d46-a5a4-54e4d16af673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf5965c-c595-46ca-8b46-e8d64caa3f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf5965c-c595-46ca-8b46-e8d64caa3f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-693938209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d6513fb734549a7c247c3ad3ffce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:46Z,use_quota=True,user_id='646c935b987d44c5b74092f84b798bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ea8386-1e24-4193-9cfd-7e26fb37b93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ea8386-1e24-4193-9cfd-7e26fb37b93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006d7fd1-3661-4454-b635-3e85b7842944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006d7fd1-3661-4454-b635-3e85b7842944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0', 'volume_name': 'volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0', 'volume_size': 1, 'snapshot_id': 'ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f632db87-f822-41e1-9cac-1d722e26a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f632db87-f822-41e1-9cac-1d722e26a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db98cddc-5b8c-4a58-a600-9e161f0178c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:45 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Volume 612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0', 'volume_size': 1, 'snapshot_id': 'ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26'} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:45 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:56:45 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:46 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 1073741824" returned: 0 in 0.957s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:46 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 Apr 29 16:56:46 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-ad130703-1a04-40db-8d3d-142f6a2e5a56-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-ad130703-1a04-40db-8d3d-142f6a2e5a56-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-quobyte-ad130703-1a04-40db-8d3d-142f6a2e5a56" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-ad130703-1a04-40db-8d3d-142f6a2e5a56" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb27d17-462d-4040-bab5-5cd507699084]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:46 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.618s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:56:46 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Deleted volume successfully. Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-950bf41e-78ca-4454-b046-87083d8e0420 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-90ae0739-b384-4ed3-b369-4af010630e25-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:46 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 Apr 29 16:56:46 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:46 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62" returned: 0 in 0.638s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.504s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Creating offline snapshot 7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 of volume f79f949f-de2e-4255-b87b-e5aa96dec93c {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2503821e-7377-40a5-82fc-c23800eba182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2038e95-de1a-4749-9091-3bab46fcec62', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7a6acd-4ae9-418d-a3ca-8297bf54cdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22d1d9b-ae3c-4d59-9245-91b7655a79e7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:46 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Volume volume-d2038e95-de1a-4749-9091-3bab46fcec62 (d2038e95-de1a-4749-9091-3bab46fcec62): created successfully Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7a6acd-4ae9-418d-a3ca-8297bf54cdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:46 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Flow 'volume_create_manager' (e97a0ca8-8daf-4d9f-a822-c1a864825fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:46 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-9057d637-7994-4dd2-8af4-76fdd4ca9bd3 tempest-CinderUnicodeTest-2099095157 None] Created volume successfully. Apr 29 16:56:46 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c Apr 29 16:56:46 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:47 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56" returned: 0 in 0.812s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:47 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56 Apr 29 16:56:47 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:47 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c" returned: 0 in 0.763s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:47 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 1G Apr 29 16:56:47 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:47 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ad130703-1a04-40db-8d3d-142f6a2e5a56" returned: 0 in 0.594s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:47 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-ad130703-1a04-40db-8d3d-142f6a2e5a56" released by "delete_volume" :: held 1.459s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Created reservations ['0228a1d9-355e-462f-a162-6377d112060b', '57ec517f-7ef6-455f-b3c9-b400064b2c14', 'c15c585d-a980-4f83-a5a8-3fc75220da33', 'd330e8e8-0c27-41f4-a1fd-d2f33528ddff'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:48 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:56:48 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:48 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 1G" returned: 0 in 0.808s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79f949f-de2e-4255-b87b-e5aa96dec93c -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:48 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79f949f-de2e-4255-b87b-e5aa96dec93c -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 Apr 29 16:56:48 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:48 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-5815fe38-d75e-4937-9013-bb3da342d5a9-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.603s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:56:48 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Deleted volume successfully. Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-5815fe38-d75e-4937-9013-bb3da342d5a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-ee55f84a-b070-4886-bec0-e3feae81391f tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-ad130703-1a04-40db-8d3d-142f6a2e5a56-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-quobyte-5815fe38-d75e-4937-9013-bb3da342d5a9" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-5815fe38-d75e-4937-9013-bb3da342d5a9" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52efbbd-fc86-475c-9c6c-6ec4cf45e1e1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:48 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9 Apr 29 16:56:48 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:49 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79f949f-de2e-4255-b87b-e5aa96dec93c -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4" returned: 0 in 0.667s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:49 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 is being set with open permissions: ugo+rw Apr 29 16:56:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:49 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 Apr 29 16:56:49 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:49 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9" returned: 0 in 0.743s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:49 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9 Apr 29 16:56:49 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:49 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4" returned: 0 in 0.591s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:49 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.info Apr 29 16:56:49 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:50 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5815fe38-d75e-4937-9013-bb3da342d5a9" returned: 0 in 0.584s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-5815fe38-d75e-4937-9013-bb3da342d5a9" released by "delete_volume" :: held 1.370s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Created reservations ['a797bd51-a77f-4e0d-8ed1-8e0b3ac77ecd', '80dc5005-90a9-49aa-a9f4-5a1769f17e74', '04bf1d44-9dbf-445c-ad5e-871023d7df6e', '3f886e20-0a54-429a-90f9-0fa0fdcc158d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:56:50 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.info" returned: 0 in 0.623s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:50 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.info is being set with open permissions: ugo+rw Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:50 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.info Apr 29 16:56:50 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:50 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:56:50 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:50 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.info" returned: 0 in 0.596s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:50 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.147s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.895s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" by "_create_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.606s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:56:50 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Deleted volume successfully. Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Creating volume 612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 from snapshot ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 {{(pid=84201) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-47643046-a22f-4601-82d8-e8a328e4c919 tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-5815fe38-d75e-4937-9013-bb3da342d5a9-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] snapshot: ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26, volume: 612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:56:50 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e4b3d5bd-0f17-4e95-a213-e30992ec334d tempest-CreateVolumesFromSnapshotTest-2108256225 None] Create snapshot completed successfully Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:50 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdb87f0-e059-4992-8206-b41b73fce8ab]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "cinder-quobyte-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27" acquired by "delete_volume" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[db02580f-8b96-4c40-b370-c76f0c339083]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:51 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 Apr 29 16:56:51 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:51 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 Apr 29 16:56:51 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:51 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26" returned: 0 in 0.739s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f050b4-544b-450a-b9de-248003e2ad27]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:51 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27" returned: 0 in 0.753s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:51 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27 Apr 29 16:56:51 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:51 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 Apr 29 16:56:51 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (9b70febf-8755-4331-ad2f-164f7c51eb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7186f855-32af-46ad-812c-fada499b57ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7186f855-32af-46ad-812c-fada499b57ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1625710810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be524714-14d2-45ec-b652-471088aa6bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:52Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb1cd46-6b14-485f-a2a4-32287beddbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb1cd46-6b14-485f-a2a4-32287beddbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d09de1-70cd-44b9-81f6-a3ef3e3234d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d09de1-70cd-44b9-81f6-a3ef3e3234d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be524714-14d2-45ec-b652-471088aa6bf4', 'volume_name': 'volume-be524714-14d2-45ec-b652-471088aa6bf4', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7619d507-b45c-43ed-bafd-6689846e0967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7619d507-b45c-43ed-bafd-6689846e0967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378591d9-278a-494c-a76f-36eed4382fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume be524714-14d2-45ec-b652-471088aa6bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be524714-14d2-45ec-b652-471088aa6bf4', 'volume_size': 1} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:52 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5" returned: 0 in 0.824s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:52 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27" returned: 0 in 0.780s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:52 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 Apr 29 16:56:52 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-quobyte-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27" released by "delete_volume" :: held 1.590s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (91b13449-fc77-45e3-b56e-c4ff443a2cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cd9ae7-b43c-430d-bcfc-51e0cadfa2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cd9ae7-b43c-430d-bcfc-51e0cadfa2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-618237616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c498b0-1d36-4fad-8fd8-ca718bfc0431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:53Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2bcf57-c749-4a50-bcef-b2361f3d0dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2bcf57-c749-4a50-bcef-b2361f3d0dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7682c6-0137-46fe-b57d-7bb0866ab180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7682c6-0137-46fe-b57d-7bb0866ab180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c498b0-1d36-4fad-8fd8-ca718bfc0431', 'volume_name': 'volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e290d84a-de08-4d1d-8cf7-cd300ad4a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e290d84a-de08-4d1d-8cf7-cd300ad4a65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82727fdd-c649-42d1-bb31-063df5ae9ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:52 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume 74c498b0-1d36-4fad-8fd8-ca718bfc0431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431', 'volume_size': 1} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Created reservations ['59bf849c-8f46-4599-84e1-aaa2c914d38e', 'b3f8d40d-5be4-427e-9a49-2fbc50560a9d', 'dda5c17b-b64b-4f01-a5a9-35166a72ad75', '1bc4ebc5-c0bc-4931-a5e0-86c43c4e0c9d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:52 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:56:52 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (7f913f41-7d07-4c22-ac23-33ac0cb416de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824598c8-a319-45a5-96a8-4c8662ea09c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824598c8-a319-45a5-96a8-4c8662ea09c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243940025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59aa7839-233f-4e0b-99b6-a8ff822fb690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:53Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef02416-a067-4c3c-8977-48fe4b1a910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef02416-a067-4c3c-8977-48fe4b1a910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca17274-ea50-4a36-9a1a-49cdca1a2142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca17274-ea50-4a36-9a1a-49cdca1a2142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59aa7839-233f-4e0b-99b6-a8ff822fb690', 'volume_name': 'volume-59aa7839-233f-4e0b-99b6-a8ff822fb690', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c015347-a514-4eab-856e-5fe72792feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c015347-a514-4eab-856e-5fe72792feee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046eb18a-897b-4cc3-b995-42cbb3f0ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume 59aa7839-233f-4e0b-99b6-a8ff822fb690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59aa7839-233f-4e0b-99b6-a8ff822fb690', 'volume_size': 1} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (051d2bd1-e69b-4501-b698-fa72c9f2718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b7e478-adc8-4a75-b545-ae33fe96b60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b7e478-adc8-4a75-b545-ae33fe96b60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217629342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:53Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8b231b-9611-4c16-8dd7-9057440ec06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8b231b-9611-4c16-8dd7-9057440ec06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a22e25c-62f5-4277-adcd-08fdca62f301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a22e25c-62f5-4277-adcd-08fdca62f301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8', 'volume_name': 'volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3959e66f-7eb0-4493-b627-e33096893644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3959e66f-7eb0-4493-b627-e33096893644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e91a3d7-f9c7-4a33-bd83-1752b5419d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:53 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8', 'volume_size': 1} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:53 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.052s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:53 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:56:53 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Deleted volume successfully. Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0d774c6e-9dfe-4168-a104-1f9073e1e78c tempest-CreateVolumesFromImageTest-1578243594 None] Lock "cinder-13f4ba2e-5396-4c2e-9c2b-8cd1d90f0f27-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (53f459d8-620a-4723-9e37-f4002c310b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b2a854-6a4b-4672-adde-7638933288b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b2a854-6a4b-4672-adde-7638933288b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-161204834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd144c89-9d22-46d6-a514-7e765c88379b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:55Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3d3507-79a1-4801-b909-87586cb9d263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3d3507-79a1-4801-b909-87586cb9d263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b2b815-f642-43e5-a75e-7e7f0bc85c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b2b815-f642-43e5-a75e-7e7f0bc85c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd144c89-9d22-46d6-a514-7e765c88379b', 'volume_name': 'volume-dd144c89-9d22-46d6-a514-7e765c88379b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e7857-327d-4990-a89a-dc689fa21d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e7857-327d-4990-a89a-dc689fa21d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d3d11f-04b6-4b37-9ca2-5fdcce917fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:54 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume dd144c89-9d22-46d6-a514-7e765c88379b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd144c89-9d22-46d6-a514-7e765c88379b', 'volume_size': 1} Apr 29 16:56:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:58 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" returned: 0 in 5.598s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:58 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f733f61d-a10b-4fb9-8974-eb8f128066dd]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:58 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 Apr 29 16:56:58 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (0165ea0e-b768-4d3d-a0a6-a08b93ee68be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2adbb42-0274-4a64-983b-c83bf5ae0986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2adbb42-0274-4a64-983b-c83bf5ae0986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1082172335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bb92f8-b2a2-4087-be34-4582b14e35ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:59Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4c27d7-984a-416f-bc68-5003f7cf657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4c27d7-984a-416f-bc68-5003f7cf657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:59 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e004274c-92f1-40cf-a606-1e2b5334d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e004274c-92f1-40cf-a606-1e2b5334d623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8bb92f8-b2a2-4087-be34-4582b14e35ac', 'volume_name': 'volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af423eab-4395-4347-8b7e-78f9d0b560af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af423eab-4395-4347-8b7e-78f9d0b560af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8fdd91-d0f8-4420-932d-6579fa5eca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:59 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume c8bb92f8-b2a2-4087-be34-4582b14e35ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac', 'volume_size': 1} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5" returned: 0 in 0.963s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:56:59 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Converted 1024.00 MB image at 182.91 MB/s Apr 29 16:56:59 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 is being set with open permissions: ugo+rw Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:59 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 Apr 29 16:56:59 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:56:59 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" returned: 0 in 0.571s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" released by "_copy_volume_from_snapshot" :: held 8.809s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" released by "_create_volume_from_snapshot" :: held 8.847s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.876s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.407s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Creating offline snapshot 4b60e790-7ff6-4b68-8eeb-34615536cc97 of volume d2038e95-de1a-4749-9091-3bab46fcec62 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db98cddc-5b8c-4a58-a600-9e161f0178c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0', 'volume_size': 1, 'snapshot_id': 'ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f91d4a-07a5-40fe-a16b-11fc76ce3b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad617492-2da6-430c-b0b6-e6e867d822d4]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:56:59 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Volume volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 (612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0): created successfully Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f91d4a-07a5-40fe-a16b-11fc76ce3b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:56:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Flow 'volume_create_manager' (6e581815-5cca-4d46-a5a4-54e4d16af673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:56:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-6fd1063b-bdc9-449c-b230-a074bb311c79 tempest-VolumeDependencyTests-1993145891 None] Created volume successfully. Apr 29 16:56:59 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 Apr 29 16:56:59 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-1dbd48c3-ec83-40ee-9e3a-755005700ca5" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-1dbd48c3-ec83-40ee-9e3a-755005700ca5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Deleting offline snapshot ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 of volume 1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] snapshot_file for this snap is: volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdc189c-8177-4e49-9386-bf32d8fc5b32]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:00 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 Apr 29 16:57:00 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:00 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62" returned: 0 in 0.753s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:00 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 1G Apr 29 16:57:00 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:00 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26" returned: 0 in 0.695s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[322fe090-86cf-4e18-b529-e955bb607c87]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:00 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 Apr 29 16:57:00 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:01 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 1G" returned: 0 in 0.780s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2038e95-de1a-4749-9091-3bab46fcec62 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:01 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2038e95-de1a-4749-9091-3bab46fcec62 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 Apr 29 16:57:01 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:01 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5" returned: 0 in 0.747s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:01 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 Apr 29 16:57:01 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:01 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2038e95-de1a-4749-9091-3bab46fcec62 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97" returned: 0 in 0.632s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:01 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 is being set with open permissions: ugo+rw Apr 29 16:57:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:01 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 Apr 29 16:57:01 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:02 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26" returned: 0 in 0.733s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:02 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26 Apr 29 16:57:02 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:02 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97" returned: 0 in 0.588s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:02 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.info Apr 29 16:57:02 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:02 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5.ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26" returned: 0 in 0.622s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26" released by "_delete_snapshot" :: held 2.899s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-1dbd48c3-ec83-40ee-9e3a-755005700ca5" released by "delete_snapshot" :: held 2.931s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Created reservations ['30d7fd3e-5f88-4d99-8136-1f67c5bda2dd', '8caa503e-1475-4ab5-83f1-7c50913c089b', 'a1089a9a-3167-4c14-aa8d-de343a66fc3b', 'a516204b-43a1-4591-944b-09b0a3fdef3b'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Delete snapshot completed successfully. Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-06e22149-ed1f-4955-a59f-56515a5b9f3d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-ce4564f7-af9a-4f01-bf0a-6d9f21bc4f26-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:03 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.info" returned: 0 in 0.614s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:03 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.info is being set with open permissions: ugo+rw Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-1dbd48c3-ec83-40ee-9e3a-755005700ca5-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:03 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.info Apr 29 16:57:03 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-1dbd48c3-ec83-40ee-9e3a-755005700ca5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-1dbd48c3-ec83-40ee-9e3a-755005700ca5" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-1dbd48c3-ec83-40ee-9e3a-755005700ca5" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbbf636-452d-4961-b024-bb7c68615f7d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:03 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 Apr 29 16:57:03 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:03 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.info" returned: 0 in 0.637s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.108s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.506s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1625710810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be524714-14d2-45ec-b652-471088aa6bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:52Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Creating volume be524714-14d2-45ec-b652-471088aa6bf4 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:03 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:03 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4 1073741824 Apr 29 16:57:03 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c4441ba5-c8d9-4887-8b02-a7baf8edc4e4 tempest-CinderUnicodeTest-2099095157 None] Create snapshot completed successfully Apr 29 16:57:04 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5" returned: 0 in 0.748s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:04 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5 Apr 29 16:57:04 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "cinder-4b60e790-7ff6-4b68-8eeb-34615536cc97-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-4b60e790-7ff6-4b68-8eeb-34615536cc97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "cinder-quobyte-d2038e95-de1a-4749-9091-3bab46fcec62" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-quobyte-d2038e95-de1a-4749-9091-3bab46fcec62" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "cinder-quobyte-4b60e790-7ff6-4b68-8eeb-34615536cc97" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-quobyte-4b60e790-7ff6-4b68-8eeb-34615536cc97" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Deleting offline snapshot 4b60e790-7ff6-4b68-8eeb-34615536cc97 of volume d2038e95-de1a-4749-9091-3bab46fcec62 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] snapshot_file for this snap is: volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e1cc9-7c5d-4e60-8bb7-57669820db7d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:04 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 Apr 29 16:57:04 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:04 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4 1073741824" returned: 0 in 0.865s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:04 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1dbd48c3-ec83-40ee-9e3a-755005700ca5" returned: 0 in 0.645s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-1dbd48c3-ec83-40ee-9e3a-755005700ca5" released by "delete_volume" :: held 1.463s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:04 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4 Apr 29 16:57:04 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:04 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:04 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Created reservations ['a5d01add-52b0-42b5-8958-196ba344b972', 'a2d996a2-b7fc-43ec-9e73-32131b154435', '7afec0bb-749d-4831-ab6d-04287264358a', '7acd5832-b686-4bf9-a16c-c768d8d42aee'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:04 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:04 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:05 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97" returned: 0 in 0.895s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2038e95-de1a-4749-9091-3bab46fcec62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[671746d1-8d3e-4e31-8da3-122e1e8f14c6]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:05 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 Apr 29 16:57:05 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:05 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.766s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:05 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4" returned: 0 in 0.821s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.869s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-618237616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c498b0-1d36-4fad-8fd8-ca718bfc0431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:53Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Creating volume 74c498b0-1d36-4fad-8fd8-ca718bfc0431 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:05 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:05 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 1073741824 Apr 29 16:57:05 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378591d9-278a-494c-a76f-36eed4382fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be524714-14d2-45ec-b652-471088aa6bf4', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4e5f2d-8eb6-4093-aae4-c51c59940724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:05 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume volume-be524714-14d2-45ec-b652-471088aa6bf4 (be524714-14d2-45ec-b652-471088aa6bf4): created successfully Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4e5f2d-8eb6-4093-aae4-c51c59940724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (9b70febf-8755-4331-ad2f-164f7c51eb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:05 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-bcd503f2-894d-4561-8191-ff634b3a66e6 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created volume successfully. Apr 29 16:57:05 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.881s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:05 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Deleted volume successfully. Apr 29 16:57:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f07ce124-a96a-459a-b25c-d4436a9bec5f tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-1dbd48c3-ec83-40ee-9e3a-755005700ca5-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Flow 'volume_create_manager' (864c29d9-c93d-4fc6-b770-3bc081bba06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea3245f-5310-48e3-90ba-e8eee8dd06b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea3245f-5310-48e3-90ba-e8eee8dd06b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1216034779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece76e35-6a1e-4379-b42a-7ca3c4ab2193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d6513fb734549a7c247c3ad3ffce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:06Z,use_quota=True,user_id='646c935b987d44c5b74092f84b798bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4b1bc0-c297-4c4a-8181-3c959ed1949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4b1bc0-c297-4c4a-8181-3c959ed1949a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8360e411-b8d9-43b5-9abb-32f26628d6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8360e411-b8d9-43b5-9abb-32f26628d6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece76e35-6a1e-4379-b42a-7ca3c4ab2193', 'volume_name': 'volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf309c10-ef43-49f6-b720-b6b6cd9cf919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf309c10-ef43-49f6-b720-b6b6cd9cf919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98df9a1-3e38-4df6-a53c-ee74e8789765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:06 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Volume ece76e35-6a1e-4379-b42a-7ca3c4ab2193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193', 'volume_size': 1} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:06 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62" returned: 0 in 0.959s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:06 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 Apr 29 16:57:06 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:06 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 1073741824" returned: 0 in 0.880s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:06 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 Apr 29 16:57:06 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:06 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97" returned: 0 in 0.688s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:06 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97 Apr 29 16:57:06 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:07 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431" returned: 0 in 0.614s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.054s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243940025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59aa7839-233f-4e0b-99b6-a8ff822fb690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:53Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Creating volume 59aa7839-233f-4e0b-99b6-a8ff822fb690 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:07 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82727fdd-c649-42d1-bb31-063df5ae9ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:07 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 1073741824 Apr 29 16:57:07 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c31abb8-7cea-4e23-8ff0-5f745aaf3b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:07 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 (74c498b0-1d36-4fad-8fd8-ca718bfc0431): created successfully Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c31abb8-7cea-4e23-8ff0-5f745aaf3b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (91b13449-fc77-45e3-b56e-c4ff443a2cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-1249f062-e5e5-4ddd-82b4-a9446b28660e tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created volume successfully. Apr 29 16:57:07 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62.4b60e790-7ff6-4b68-8eeb-34615536cc97" returned: 0 in 0.627s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-quobyte-4b60e790-7ff6-4b68-8eeb-34615536cc97" released by "_delete_snapshot" :: held 3.293s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-quobyte-d2038e95-de1a-4749-9091-3bab46fcec62" released by "delete_snapshot" :: held 3.318s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Created reservations ['2a0d41f4-214a-4d80-b99d-4999657ba4b0', 'b6c70aca-3dda-46c3-b0fd-2e1ad9c719ce', '47f1c0a9-3e77-4252-962a-66d0b46850a9', '467653ff-09cf-4888-96fa-474033c5c3b4'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Delete snapshot completed successfully. Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-cd8455ac-bf25-47c8-9632-f69a6bf1821b tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-4b60e790-7ff6-4b68-8eeb-34615536cc97-delete_snapshot" released by "delete_snapshot" :: held 3.457s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:07 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 1073741824" returned: 0 in 0.802s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:08 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 Apr 29 16:57:08 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "cinder-d2038e95-de1a-4749-9091-3bab46fcec62-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-d2038e95-de1a-4749-9091-3bab46fcec62-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "cinder-quobyte-d2038e95-de1a-4749-9091-3bab46fcec62" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-quobyte-d2038e95-de1a-4749-9091-3bab46fcec62" acquired by "delete_volume" :: waited 0.029s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:08 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690" returned: 0 in 0.624s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.887s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217629342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:53Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Creating volume a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:08 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9becf23a-f4ec-4a29-b599-847fce61203d]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:08 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 1073741824 Apr 29 16:57:08 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046eb18a-897b-4cc3-b995-42cbb3f0ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59aa7839-233f-4e0b-99b6-a8ff822fb690', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadc45d5-9093-407b-9072-0a89d9e91463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:08 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 (59aa7839-233f-4e0b-99b6-a8ff822fb690): created successfully Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadc45d5-9093-407b-9072-0a89d9e91463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:08 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (7f913f41-7d07-4c22-ac23-33ac0cb416de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:08 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b22ef34d-fc34-4990-a6f4-c68d65ebb8b5 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created volume successfully. Apr 29 16:57:08 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 Apr 29 16:57:08 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:09 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62" returned: 0 in 0.738s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:09 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62 Apr 29 16:57:09 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:09 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 1073741824" returned: 0 in 0.785s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:09 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 Apr 29 16:57:09 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:09 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:09 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-d2038e95-de1a-4749-9091-3bab46fcec62" returned: 0 in 0.586s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-quobyte-d2038e95-de1a-4749-9091-3bab46fcec62" released by "delete_volume" :: held 1.402s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:10 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8" returned: 0 in 0.588s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.161s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-161204834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd144c89-9d22-46d6-a514-7e765c88379b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8579cd038624ddc8aebbf40251ab3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:55Z,use_quota=True,user_id='98243f58258948038a210c068aa1d658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Creating volume dd144c89-9d22-46d6-a514-7e765c88379b {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:10 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Created reservations ['7c7f0890-3445-460f-a393-34370f54f716', '17f7ee90-b719-4995-8070-23ca5a88e6a4', 'a419a8a4-c7a0-431c-935c-b0bca5c58ee6', '97116c08-dae8-4e35-b80c-c2987e9065ad'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e91a3d7-f9c7-4a33-bd83-1752b5419d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:10 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b 1073741824 Apr 29 16:57:10 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd998f56-92bf-4049-9849-9c0f7d459918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:10 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 (a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8): created successfully Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd998f56-92bf-4049-9849-9c0f7d459918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (051d2bd1-e69b-4501-b698-fa72c9f2718e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:10 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5f33db08-b2b2-4342-9897-9daca37ac79c tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created volume successfully. Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:10 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:10 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "cinder-054b96b9-75a7-412c-8e2d-7572bc492a73-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-054b96b9-75a7-412c-8e2d-7572bc492a73-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:10 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.607s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:10 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Deleted volume successfully. Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "cinder-quobyte-054b96b9-75a7-412c-8e2d-7572bc492a73" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-8df198cf-aac6-4d02-bff2-76acb54f25fb tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-d2038e95-de1a-4749-9091-3bab46fcec62-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-quobyte-054b96b9-75a7-412c-8e2d-7572bc492a73" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb86b949-8b76-4a21-a843-95dca9b8cbbc]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:10 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b 1073741824" returned: 0 in 0.845s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:10 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:10 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b Apr 29 16:57:10 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:11 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73 Apr 29 16:57:11 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:11 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b" returned: 0 in 0.596s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.401s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1082172335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bb92f8-b2a2-4087-be34-4582b14e35ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:56:59Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Creating volume c8bb92f8-b2a2-4087-be34-4582b14e35ac {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:11 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:11 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac 1073741824 Apr 29 16:57:11 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d3d11f-04b6-4b37-9ca2-5fdcce917fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd144c89-9d22-46d6-a514-7e765c88379b', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4338c0f8-f5e4-4015-8a00-0505e66a1358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:11 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Volume volume-dd144c89-9d22-46d6-a514-7e765c88379b (dd144c89-9d22-46d6-a514-7e765c88379b): created successfully Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4338c0f8-f5e4-4015-8a00-0505e66a1358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Flow 'volume_create_manager' (53f459d8-620a-4723-9e37-f4002c310b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:11 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-2d53b373-f083-46d2-bb48-21903cc935fb tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created volume successfully. Apr 29 16:57:11 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73" returned: 0 in 0.752s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:11 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:11 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73 Apr 29 16:57:11 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:12 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-054b96b9-75a7-412c-8e2d-7572bc492a73" returned: 0 in 0.618s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-quobyte-054b96b9-75a7-412c-8e2d-7572bc492a73" released by "delete_volume" :: held 1.421s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-dd144c89-9d22-46d6-a514-7e765c88379b-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Created reservations ['59e45e14-07e5-41d6-96f1-3b970e999c5d', '7d073893-b02a-4058-8122-2ffc024a3b66', '8911abca-d3af-4c40-9ff9-e81d333deace', '6f70ae07-c380-4012-a38a-70fb72369973'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-dd144c89-9d22-46d6-a514-7e765c88379b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:12 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-quobyte-dd144c89-9d22-46d6-a514-7e765c88379b" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac 1073741824" returned: 0 in 0.914s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-dd144c89-9d22-46d6-a514-7e765c88379b" acquired by "delete_volume" :: waited 0.036s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0ab77d-2bc4-4708-9c3d-fba60f26eeb5]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:12 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:12 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:12 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:12 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac Apr 29 16:57:12 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:12 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b Apr 29 16:57:12 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:13 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.672s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:13 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Deleted volume successfully. Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f3f9b231-2f7f-4576-a343-15a3d7542fca tempest-CinderUnicodeTest-2099095157 None] Lock "cinder-054b96b9-75a7-412c-8e2d-7572bc492a73-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:13 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac" returned: 0 in 0.711s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.194s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1216034779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece76e35-6a1e-4379-b42a-7ca3c4ab2193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d6513fb734549a7c247c3ad3ffce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:06Z,use_quota=True,user_id='646c935b987d44c5b74092f84b798bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Creating volume ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:13 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8fdd91-d0f8-4420-932d-6579fa5eca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:13 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 1073741824 Apr 29 16:57:13 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707bc4fb-5ae7-418b-9f9a-260a6dc36fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:13 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac (c8bb92f8-b2a2-4087-be34-4582b14e35ac): created successfully Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707bc4fb-5ae7-418b-9f9a-260a6dc36fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (0165ea0e-b768-4d3d-a0a6-a08b93ee68be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:13 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:13 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-247e2379-2dd2-4361-8f16-9953b3184929 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created volume successfully. Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b" returned: 0 in 0.829s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:13 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:13 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b Apr 29 16:57:13 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:14 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-dd144c89-9d22-46d6-a514-7e765c88379b" returned: 0 in 0.825s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-dd144c89-9d22-46d6-a514-7e765c88379b" released by "delete_volume" :: held 1.734s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created reservations ['a3ad322a-bf9c-4cb2-8e7a-beb772bab871', 'd7231919-f867-4a9f-9b5c-1e83f44cfc5a', '68bc01ec-6c99-48fe-8fe7-114656fcf28d', '644d3cc7-0c6f-49d2-a419-9dccba614a35'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:14 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 1073741824" returned: 0 in 1.040s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:14 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 Apr 29 16:57:14 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:14 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:14 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (801c74bb-bc10-4632-980d-b3646fe48b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea44cd8-ff0a-4f3e-8d6e-b5928ae8b8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea44cd8-ff0a-4f3e-8d6e-b5928ae8b8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-115407028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ef403f-a118-44c6-a0da-1202894a77dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:15Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7c64c2-510d-4126-b9eb-1735407acfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7c64c2-510d-4126-b9eb-1735407acfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e15834-b65a-4c80-9e6b-c3dbb3131040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e15834-b65a-4c80-9e6b-c3dbb3131040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24ef403f-a118-44c6-a0da-1202894a77dc', 'volume_name': 'volume-24ef403f-a118-44c6-a0da-1202894a77dc', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730b3223-c537-49ab-9ea5-9337f5306a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:14 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730b3223-c537-49ab-9ea5-9337f5306a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876637d0-cd84-48e8-b9aa-1290727ff2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:15 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume 24ef403f-a118-44c6-a0da-1202894a77dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24ef403f-a118-44c6-a0da-1202894a77dc', 'volume_size': 1} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-quobyte-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93d0c0c-da38-4ae7-bbc2-1b371068fe9c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:15 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 Apr 29 16:57:15 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (99ea0d85-16fa-40d9-883f-8f7b80960660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867f7e7-a75c-4ec7-982c-ff9b71a09603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867f7e7-a75c-4ec7-982c-ff9b71a09603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-917317797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9cc794-4487-4cf6-91e7-9a2563698372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:15Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2bf80b-ea08-464b-80ea-deae1866c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2bf80b-ea08-464b-80ea-deae1866c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5086a14e-e83d-478f-a2c8-c4997b5cf933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:15 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5086a14e-e83d-478f-a2c8-c4997b5cf933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9cc794-4487-4cf6-91e7-9a2563698372', 'volume_name': 'volume-1f9cc794-4487-4cf6-91e7-9a2563698372', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0d27fe-754c-4fc0-b2f6-501412c0f690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0d27fe-754c-4fc0-b2f6-501412c0f690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b622a5a5-8f3c-4038-b918-d3d5c01cf0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:15 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume 1f9cc794-4487-4cf6-91e7-9a2563698372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9cc794-4487-4cf6-91e7-9a2563698372', 'volume_size': 1} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" returned: 0 in 1.046s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-115407028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ef403f-a118-44c6-a0da-1202894a77dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:15Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Creating volume 24ef403f-a118-44c6-a0da-1202894a77dc {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:15 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98df9a1-3e38-4df6-a53c-ee74e8789765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6f10fa-8c80-41ea-b6c6-c8ecb5bf5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:15 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc 1073741824 Apr 29 16:57:15 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:15 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Volume volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 (ece76e35-6a1e-4379-b42a-7ca3c4ab2193): created successfully Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6f10fa-8c80-41ea-b6c6-c8ecb5bf5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Flow 'volume_create_manager' (864c29d9-c93d-4fc6-b770-3bc081bba06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-81835f83-326e-47b1-8c88-c00c071053eb tempest-VolumeDependencyTests-1993145891 None] Created volume successfully. Apr 29 16:57:15 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 1.411s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:15 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Deleted volume successfully. Apr 29 16:57:15 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-71c0df72-f27e-4085-9b4f-90897ef9f867 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-dd144c89-9d22-46d6-a514-7e765c88379b-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (0b4c67fd-d9e5-4002-bdc2-f363c384a45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699623d0-c1ee-44b7-99f4-9aeb196589d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699623d0-c1ee-44b7-99f4-9aeb196589d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063932864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:16Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da0b5d2-f764-4341-960a-82b9d6ebdeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da0b5d2-f764-4341-960a-82b9d6ebdeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcdf805-99d9-4dac-985f-a1b4c2b325fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcdf805-99d9-4dac-985f-a1b4c2b325fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1', 'volume_name': 'volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a827d9-c745-48c4-93f3-b23dcc5a368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a827d9-c745-48c4-93f3-b23dcc5a368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4efc6e7-543b-4146-ba63-8e3fcde66fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume 4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1', 'volume_size': 1} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:16 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8" returned: 0 in 1.303s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:16 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8 Apr 29 16:57:16 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Flow 'volume_create_manager' (b8a50041-6643-49f7-856c-b8723079c84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd96c7a-9c31-4e1a-8320-02d5b2df6092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd96c7a-9c31-4e1a-8320-02d5b2df6092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-895879277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e40d79f-ecc1-47bc-902a-9f6818aea937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0d6513fb734549a7c247c3ad3ffce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ece76e35-6a1e-4379-b42a-7ca3c4ab2193,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:17Z,use_quota=True,user_id='646c935b987d44c5b74092f84b798bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf76afe-5d30-4c40-8c4e-2da795e66e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf76afe-5d30-4c40-8c4e-2da795e66e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899ef2d6-e8a0-42f0-8e94-2ec0f74a8a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc 1073741824" returned: 0 in 1.408s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899ef2d6-e8a0-42f0-8e94-2ec0f74a8a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8e40d79f-ecc1-47bc-902a-9f6818aea937', 'volume_name': 'volume-8e40d79f-ecc1-47bc-902a-9f6818aea937', 'volume_size': 1, 'source_volid': 'ece76e35-6a1e-4379-b42a-7ca3c4ab2193', 'source_volstatus': 'available'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbee4883-c162-4c16-89a0-a391f11853c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbee4883-c162-4c16-89a0-a391f11853c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0281ba3f-5cd3-4315-807a-fe74a9bf1833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:16 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Volume 8e40d79f-ecc1-47bc-902a-9f6818aea937: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8e40d79f-ecc1-47bc-902a-9f6818aea937', 'volume_size': 1, 'source_volid': 'ece76e35-6a1e-4379-b42a-7ca3c4ab2193', 'source_volstatus': 'available'} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:16 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (c6c89e74-caf5-46ca-8be4-422ecad19482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ee11ad-b3f5-4a14-ab59-14bcea66b9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ee11ad-b3f5-4a14-ab59-14bcea66b9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918282806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3404b7bc-4942-4313-84e0-ced56cad0ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:17Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d9eb69-3757-4f57-a00a-9c99ffcc8a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d9eb69-3757-4f57-a00a-9c99ffcc8a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:17 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc Apr 29 16:57:17 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73373fc9-e6a5-4f82-a3fc-689b3c592114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73373fc9-e6a5-4f82-a3fc-689b3c592114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3404b7bc-4942-4313-84e0-ced56cad0ce3', 'volume_name': 'volume-3404b7bc-4942-4313-84e0-ced56cad0ce3', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058c42c-81b4-40ce-988f-5a4b368dd83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058c42c-81b4-40ce-988f-5a4b368dd83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b503000-18ad-44ba-b462-f714e12c0b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume 3404b7bc-4942-4313-84e0-ced56cad0ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3404b7bc-4942-4313-84e0-ced56cad0ce3', 'volume_size': 1} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:57:17 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (9961b369-d4ce-45b9-b9c1-0a4b1abeb2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57c8c2c-ea56-4196-85d4-ac4e04e17289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8" returned: 0 in 0.910s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57c8c2c-ea56-4196-85d4-ac4e04e17289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-987260441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed9e595-f8cd-48ae-863c-b5dc21c16098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:17Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8e28b6-8099-4002-ab4f-c5891e7d4c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8e28b6-8099-4002-ab4f-c5891e7d4c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19b68eb-a00a-4194-a788-2653764b7a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19b68eb-a00a-4194-a788-2653764b7a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed9e595-f8cd-48ae-863c-b5dc21c16098', 'volume_name': 'volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c58c41-6461-43e0-ba76-931beb325c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c58c41-6461-43e0-ba76-931beb325c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad911279-c320-4fbc-ba91-361e2008e06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:17 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume 5ed9e595-f8cd-48ae-863c-b5dc21c16098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098', 'volume_size': 1} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8" released by "delete_volume" :: held 2.336s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created reservations ['7ca53d19-8d2b-4c45-8b1f-06dc9e0f687a', '7092b8f6-48af-433d-9d96-35617a622a06', '30fec60c-e6d4-43ab-a5e6-4371ef3af6f5', '2985c03f-6938-449a-a8e9-a3a27a204f31'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:17 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:17 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:17 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc" returned: 0 in 0.957s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] <== create_volume: return (2505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.508s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-917317797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9cc794-4487-4cf6-91e7-9a2563698372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:15Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Creating volume 1f9cc794-4487-4cf6-91e7-9a2563698372 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:17 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:17 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876637d0-cd84-48e8-b9aa-1290727ff2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24ef403f-a118-44c6-a0da-1202894a77dc', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:18 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372 1073741824 Apr 29 16:57:18 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df865cce-5dec-4d52-ab2b-2dfc7c21f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:18 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume volume-24ef403f-a118-44c6-a0da-1202894a77dc (24ef403f-a118-44c6-a0da-1202894a77dc): created successfully Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df865cce-5dec-4d52-ab2b-2dfc7c21f168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (801c74bb-bc10-4632-980d-b3646fe48b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:18 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e23c64aa-9ba6-4ad2-892a-8f2829e079b7 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created volume successfully. Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-59aa7839-233f-4e0b-99b6-a8ff822fb690-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-59aa7839-233f-4e0b-99b6-a8ff822fb690-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:18 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.859s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:18 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Deleted volume successfully. Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f8da1892-5f5c-46a3-bca6-38c1f6063c1a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-a475be6a-7bf6-4ba3-8ca0-e188a5a88cb8-delete_volume" released by "delete_volume" :: held 3.637s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-quobyte-59aa7839-233f-4e0b-99b6-a8ff822fb690" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-59aa7839-233f-4e0b-99b6-a8ff822fb690" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[56affa14-8c7f-4eab-b193-fd06a064f4ea]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:18 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:18 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 Apr 29 16:57:18 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:19 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372 1073741824" returned: 0 in 1.078s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:19 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372 Apr 29 16:57:19 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:19 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690" returned: 0 in 0.833s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:19 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690 Apr 29 16:57:19 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:19 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372" returned: 0 in 0.692s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.519s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063932864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:16Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Creating volume 4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:19 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b622a5a5-8f3c-4038-b918-d3d5c01cf0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9cc794-4487-4cf6-91e7-9a2563698372', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f14cec2-f8a8-4aa4-bd9a-3a652490cabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:19 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 1073741824 Apr 29 16:57:19 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:19 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume volume-1f9cc794-4487-4cf6-91e7-9a2563698372 (1f9cc794-4487-4cf6-91e7-9a2563698372): created successfully Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f14cec2-f8a8-4aa4-bd9a-3a652490cabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:19 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (99ea0d85-16fa-40d9-883f-8f7b80960660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:19 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-62702f8d-f4da-4d9a-8de2-af4a93ea87b4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created volume successfully. Apr 29 16:57:20 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-59aa7839-233f-4e0b-99b6-a8ff822fb690" returned: 0 in 0.718s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-59aa7839-233f-4e0b-99b6-a8ff822fb690" released by "delete_volume" :: held 1.595s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created reservations ['2356a96e-0cf2-4180-a571-97d265165cfc', '2157fa22-1bcc-4677-8b6a-44589beae108', '7e34f8da-e85d-4468-abcd-cea171cfe8d8', '43536358-7da7-4046-a505-5db2cf3d2c36'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:20 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:20 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-74c498b0-1d36-4fad-8fd8-ca718bfc0431-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-74c498b0-1d36-4fad-8fd8-ca718bfc0431-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:SELECT=114,cinder:UPDATE=162,cinder:INSERT=39,cinder:DELETE=14 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:57:20 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 1073741824" returned: 0 in 0.955s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-quobyte-74c498b0-1d36-4fad-8fd8-ca718bfc0431" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-74c498b0-1d36-4fad-8fd8-ca718bfc0431" acquired by "delete_volume" :: waited 0.037s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a70639-41ad-49b2-b9c4-ad201c68d68a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:20 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:20 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 Apr 29 16:57:20 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:21 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.803s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:21 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Deleted volume successfully. Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c5e1a557-a6d1-49b3-8240-1cdd100c0d10 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-59aa7839-233f-4e0b-99b6-a8ff822fb690-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:21 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 Apr 29 16:57:21 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:21 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1" returned: 0 in 0.630s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.555s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:21 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Cloning volume ece76e35-6a1e-4379-b42a-7ca3c4ab2193 to volume 8e40d79f-ecc1-47bc-902a-9f6818aea937 Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:UPDATE=165,cinder:SELECT=130,cinder:INSERT=35,cinder:DELETE=18 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4efc6e7-543b-4146-ba63-8e3fcde66fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0439a18-c2e6-4e3e-8181-45a4912bd651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Creating offline snapshot 2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 of volume ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:57:21 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 (4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1): created successfully Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0439a18-c2e6-4e3e-8181-45a4912bd651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (0b4c67fd-d9e5-4002-bdc2-f363c384a45a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54b6f52-9d9d-4cf3-912e-eac7888c6049]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:21 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-cd6ada07-7555-439f-b7d9-ff1301b86431 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created volume successfully. Apr 29 16:57:21 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431" returned: 0 in 0.799s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:21 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:21 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 Apr 29 16:57:21 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:21 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431 Apr 29 16:57:21 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:22 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" returned: 0 in 0.850s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:22 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 1G Apr 29 16:57:22 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:22 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-74c498b0-1d36-4fad-8fd8-ca718bfc0431" returned: 0 in 0.775s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-74c498b0-1d36-4fad-8fd8-ca718bfc0431" released by "delete_volume" :: held 1.649s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created reservations ['222b4573-eb90-4b61-8932-99c1601048d7', '381a2ba1-91db-445c-9462-68bfadfdffc8', '31164c18-f095-4ed7-b5d9-fc98889d9678', '92b006d3-8d7a-4fb1-b7ca-99aa583ee68b'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:22 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:22 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:22 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-be524714-14d2-45ec-b652-471088aa6bf4-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-be524714-14d2-45ec-b652-471088aa6bf4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-quobyte-be524714-14d2-45ec-b652-471088aa6bf4" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-be524714-14d2-45ec-b652-471088aa6bf4" acquired by "delete_volume" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f12948-94c8-47c5-8b0e-89dda7c1b49a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:23 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4 Apr 29 16:57:23 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:23 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.805s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:23 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Deleted volume successfully. Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-c1e5faa8-d46b-4be7-bc2f-253e0282de2a tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-74c498b0-1d36-4fad-8fd8-ca718bfc0431-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:23 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 1G" returned: 0 in 1.205s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:23 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:23 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 Apr 29 16:57:23 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:24 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4" returned: 0 in 0.953s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:24 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4 Apr 29 16:57:24 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:24 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8" returned: 0 in 0.889s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:24 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 is being set with open permissions: ugo+rw Apr 29 16:57:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:24 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 Apr 29 16:57:24 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:24 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:24 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-be524714-14d2-45ec-b652-471088aa6bf4" returned: 0 in 0.695s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:24 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-be524714-14d2-45ec-b652-471088aa6bf4" released by "delete_volume" :: held 1.712s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:24 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created reservations ['7975958c-4a2c-4a8d-97de-932f8ad0d371', '493716a8-f063-487c-93f9-2598ebf439ea', '8f012f05-5842-40a8-ac90-3ca8cf891be8', '01c4a730-4cd4-466d-8f90-b0d5c815ee80'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:25 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:25 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:25 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8" returned: 0 in 0.765s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-quobyte-f79f949f-de2e-4255-b87b-e5aa96dec93c" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-f79f949f-de2e-4255-b87b-e5aa96dec93c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-quobyte-7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:25 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.info Apr 29 16:57:25 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Deleting offline snapshot 7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 of volume f79f949f-de2e-4255-b87b-e5aa96dec93c {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] snapshot_file for this snap is: volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca17d6c2-48f0-4e0c-b501-1b04279dd440]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:25 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 Apr 29 16:57:25 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:25 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.722s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:25 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Deleted volume successfully. Apr 29 16:57:25 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-46b9c1f7-ec9e-4808-ae1b-3288d6357727 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-be524714-14d2-45ec-b652-471088aa6bf4-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:26 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.info" returned: 0 in 0.693s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:26 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.info is being set with open permissions: ugo+rw Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:26 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.info Apr 29 16:57:26 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:26 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4" returned: 0 in 0.881s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f79f949f-de2e-4255-b87b-e5aa96dec93c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b4e1b4-097e-49e1-95e5-c8d6dc64840e]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:26 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c Apr 29 16:57:26 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:26 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.info" returned: 0 in 0.688s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-8e40d79f-ecc1-47bc-902a-9f6818aea937" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-8e40d79f-ecc1-47bc-902a-9f6818aea937" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] snapshot: 2fdfbdbe-7a3f-480e-8fef-2f533130e7c8, volume: 8e40d79f-ecc1-47bc-902a-9f6818aea937, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c941e-d8ed-4b69-9cb1-66cff0ff8c5a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:26 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:26 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 Apr 29 16:57:26 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:27 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c" returned: 0 in 0.864s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:27 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 Apr 29 16:57:27 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:27 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8" returned: 0 in 0.933s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:57:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:57:27 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:57:27 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[418a67d9-38b5-4946-8474-ef8cf747e806]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:27 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:27 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 Apr 29 16:57:27 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:28 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4" returned: 0 in 0.768s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:28 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4 Apr 29 16:57:28 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:28 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" returned: 0 in 0.835s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:28 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 Apr 29 16:57:28 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:28 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c.7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4" returned: 0 in 0.675s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4" released by "_delete_snapshot" :: held 3.333s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-f79f949f-de2e-4255-b87b-e5aa96dec93c" released by "delete_snapshot" :: held 3.375s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created reservations ['b58ab1f4-b5b2-4f6f-8c37-dea25e577562', '7cf2e080-8a74-48d5-9311-612ce3ee12ac', '1822b9fa-f9e9-43e3-ad84-97e945e6712a', 'f94ce7b6-8406-4b8b-8151-baf32c5ac823'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:28 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Delete snapshot completed successfully. Apr 29 16:57:28 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-64a8577c-7ee9-4ba7-ab4c-b327de5095f2 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-7ffa0946-c1fc-4eb5-ae8d-91fd66b920a4-delete_snapshot" released by "delete_snapshot" :: held 3.564s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-f79f949f-de2e-4255-b87b-e5aa96dec93c-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-f79f949f-de2e-4255-b87b-e5aa96dec93c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "cinder-quobyte-f79f949f-de2e-4255-b87b-e5aa96dec93c" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:29 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-f79f949f-de2e-4255-b87b-e5aa96dec93c" acquired by "delete_volume" :: waited 0.037s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:29 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77a42d0-2e88-4514-b861-fe49dd76034b]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:29 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:30 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c Apr 29 16:57:30 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:31 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c" returned: 0 in 1.562s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:31 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:31 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c Apr 29 16:57:31 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:33 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-f79f949f-de2e-4255-b87b-e5aa96dec93c" returned: 0 in 2.073s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:33 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-quobyte-f79f949f-de2e-4255-b87b-e5aa96dec93c" released by "delete_volume" :: held 3.801s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:33 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Created reservations ['c7833891-eb77-457d-851e-87232428ef05', '4f552876-34e1-4bfd-9d66-8253a3c2adfe', '7e5a0359-55a4-4934-97f6-b21fe1b6f32c', 'a6d327f0-602c-4f97-8e9b-693e0d5da921'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:33 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:33 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:34 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:34 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:34 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937" returned: 0 in 5.928s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:34 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a06542-c4a8-4b1b-94c7-6dfe40f6bec4]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:34 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 Apr 29 16:57:34 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:34 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:34 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.752s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:34 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:34 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Deleted volume successfully. Apr 29 16:57:34 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-0e17215b-4f2a-4b4e-a24d-0eedb3926f90 tempest-CreateVolumesFromSnapshotTest-2108256225 None] Lock "cinder-f79f949f-de2e-4255-b87b-e5aa96dec93c-delete_volume" released by "delete_volume" :: held 5.040s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:35 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" returned: 0 in 0.984s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:35 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:57:35 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Converted 1024.00 MB image at 172.67 MB/s Apr 29 16:57:35 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 is being set with open permissions: ugo+rw Apr 29 16:57:35 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:35 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 Apr 29 16:57:35 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:36 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937" returned: 0 in 0.755s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-8e40d79f-ecc1-47bc-902a-9f6818aea937" released by "_copy_volume_from_snapshot" :: held 9.531s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-2fdfbdbe-7a3f-480e-8fef-2f533130e7c8" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:36 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-2fdfbdbe-7a3f-480e-8fef-2f533130e7c8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Deleting offline snapshot 2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 of volume ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:57:36 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] snapshot_file for this snap is: volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:57:36 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00818ff-c49a-4bdf-960e-086ad36a84f1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:36 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:36 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 Apr 29 16:57:36 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:37 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8" returned: 0 in 0.733s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:37 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:57:37 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[be748472-0ebd-4c9b-ae8a-2a259197103a]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:37 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 Apr 29 16:57:37 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:37 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" returned: 0 in 0.743s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:37 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:37 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 Apr 29 16:57:37 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:38 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8" returned: 0 in 0.704s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:38 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:38 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8 Apr 29 16:57:38 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:39 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193.2fdfbdbe-7a3f-480e-8fef-2f533130e7c8" returned: 0 in 0.612s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-2fdfbdbe-7a3f-480e-8fef-2f533130e7c8" released by "_delete_snapshot" :: held 2.896s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.778s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.150s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918282806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3404b7bc-4942-4313-84e0-ced56cad0ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:17Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Creating volume 3404b7bc-4942-4313-84e0-ced56cad0ce3 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:39 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0281ba3f-5cd3-4315-807a-fe74a9bf1833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e40d79f-ecc1-47bc-902a-9f6818aea937', 'volume_size': 1, 'source_volid': 'ece76e35-6a1e-4379-b42a-7ca3c4ab2193', 'source_volstatus': 'available'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:39 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 1073741824 Apr 29 16:57:39 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed5866f-d403-4407-9683-c2dc2fb40b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:39 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Volume volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 (8e40d79f-ecc1-47bc-902a-9f6818aea937): created successfully Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed5866f-d403-4407-9683-c2dc2fb40b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Flow 'volume_create_manager' (b8a50041-6643-49f7-856c-b8723079c84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:39 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-20ee2b18-40e3-4425-aaab-28071fec8304 tempest-VolumeDependencyTests-1993145891 None] Created volume successfully. Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-ece76e35-6a1e-4379-b42a-7ca3c4ab2193-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-ece76e35-6a1e-4379-b42a-7ca3c4ab2193-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04975ab-dea6-4633-a773-4b0074cd9ec7]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:39 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:40 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 Apr 29 16:57:40 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:40 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 1073741824" returned: 0 in 0.892s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:40 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 Apr 29 16:57:40 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:40 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" returned: 0 in 0.877s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:40 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193 Apr 29 16:57:40 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:40 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3" returned: 0 in 0.644s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.533s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-987260441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed9e595-f8cd-48ae-863c-b5dc21c16098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed332e5cdf6420dba00521f6c53734c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:17Z,use_quota=True,user_id='6af78094a81548b89a90482752d62841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Creating volume 5ed9e595-f8cd-48ae-863c-b5dc21c16098 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:40 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:40 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 1073741824 Apr 29 16:57:40 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b503000-18ad-44ba-b462-f714e12c0b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3404b7bc-4942-4313-84e0-ced56cad0ce3', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:40 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfbe9fb-2617-41fd-b183-357b399f2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:41 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 (3404b7bc-4942-4313-84e0-ced56cad0ce3): created successfully Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfbe9fb-2617-41fd-b183-357b399f2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (c6c89e74-caf5-46ca-8be4-422ecad19482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:41 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-af0f2fb9-96cb-44e6-b7d8-fca4d4009b4d tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created volume successfully. Apr 29 16:57:41 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" returned: 0 in 0.663s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-ece76e35-6a1e-4379-b42a-7ca3c4ab2193" released by "delete_volume" :: held 1.606s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Created reservations ['5355af70-b873-4417-99aa-b2bebc02c770', '188a611e-8c66-42d3-bac4-cd9819897875', 'b61c45d8-bb85-4117-9018-fb60fea327e9', '73b90b22-3607-44bd-bdf6-2904113167e3'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:41 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:41 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:41 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 1073741824" returned: 0 in 0.935s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:41 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:41 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 Apr 29 16:57:41 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-8e40d79f-ecc1-47bc-902a-9f6818aea937-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-8e40d79f-ecc1-47bc-902a-9f6818aea937-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-8e40d79f-ecc1-47bc-902a-9f6818aea937" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-8e40d79f-ecc1-47bc-902a-9f6818aea937" acquired by "delete_volume" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3effb098-de27-477c-bfd5-42c8946651b6]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:42 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 Apr 29 16:57:42 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:42 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.817s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:42 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Deleted volume successfully. Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d1ae1f95-1800-4e3d-b625-a08937c70041 tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-ece76e35-6a1e-4379-b42a-7ca3c4ab2193-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:42 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098" returned: 0 in 0.766s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad911279-c320-4fbc-ba91-361e2008e06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe14b6de-57b6-4824-8269-3369608460eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:42 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Volume volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 (5ed9e595-f8cd-48ae-863c-b5dc21c16098): created successfully Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe14b6de-57b6-4824-8269-3369608460eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Flow 'volume_create_manager' (9961b369-d4ce-45b9-b9c1-0a4b1abeb2f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:42 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-313e7136-97ca-44d0-adee-c4eae4019829 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created volume successfully. Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-5ed9e595-f8cd-48ae-863c-b5dc21c16098-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-5ed9e595-f8cd-48ae-863c-b5dc21c16098-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-quobyte-5ed9e595-f8cd-48ae-863c-b5dc21c16098" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-5ed9e595-f8cd-48ae-863c-b5dc21c16098" acquired by "delete_volume" :: waited 0.015s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c7ef85-9cf0-4862-9887-0127b2d343a8]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:42 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:43 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937" returned: 0 in 0.827s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:43 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937 Apr 29 16:57:43 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:43 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 Apr 29 16:57:43 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Flow 'volume_create_manager' (290c7c2b-300b-4a26-8e93-fb0636a4b483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6303948d-a2d6-401f-8f54-b688bdc45525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6303948d-a2d6-401f-8f54-b688bdc45525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1761302116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4177a2f7-9597-4c2c-b06d-fab0ca932190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5d58882b2d4cdd8e01d212a4032fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:43Z,use_quota=True,user_id='c7aa52b169e145cabc2b72a45ebcf812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88cfd2b-4a13-422c-8884-d6d116ce393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88cfd2b-4a13-422c-8884-d6d116ce393f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7f9ef3-f6c3-4aab-99ab-a73e94c9a788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7f9ef3-f6c3-4aab-99ab-a73e94c9a788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4177a2f7-9597-4c2c-b06d-fab0ca932190', 'volume_name': 'volume-4177a2f7-9597-4c2c-b06d-fab0ca932190', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d075efb3-0313-4fef-bed6-24dd6134e12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d075efb3-0313-4fef-bed6-24dd6134e12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14b32cd-12f0-405a-b5a6-1d0e729b9f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:43 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Volume 4177a2f7-9597-4c2c-b06d-fab0ca932190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4177a2f7-9597-4c2c-b06d-fab0ca932190', 'volume_size': 1} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1761302116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4177a2f7-9597-4c2c-b06d-fab0ca932190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5d58882b2d4cdd8e01d212a4032fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:43Z,use_quota=True,user_id='c7aa52b169e145cabc2b72a45ebcf812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)}" {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Creating volume 4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:43 devstack cinder-volume[84201]: INFO cinder.volume.drivers.remotefs [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] casted to osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 1073741824 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:43 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 1073741824 Apr 29 16:57:43 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:43 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-8e40d79f-ecc1-47bc-902a-9f6818aea937" returned: 0 in 0.675s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-8e40d79f-ecc1-47bc-902a-9f6818aea937" released by "delete_volume" :: held 1.560s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:43 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098" returned: 0 in 0.764s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:43 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098 Apr 29 16:57:43 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Created reservations ['e44a4d59-c5bd-4982-8ea3-891707f8664d', '693eb5df-9623-4994-a43a-2cbf3536f646', 'b2a76ea5-e5c8-4ace-87f7-487b2208109d', '3abac863-2f20-4f15-a20e-ce802dbe7d5b'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:43 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:43 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:43 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:44 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 1073741824" returned: 0 in 0.799s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:44 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 Apr 29 16:57:44 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:44 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-5ed9e595-f8cd-48ae-863c-b5dc21c16098" returned: 0 in 0.608s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-5ed9e595-f8cd-48ae-863c-b5dc21c16098" released by "delete_volume" :: held 1.429s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created reservations ['4f0b640b-0f99-4562-a563-cf2fcad2324f', '4de0fa26-e2d7-48dd-9380-6271df039544', '45bb435b-9dc8-49b1-84de-749250028b9e', '297e7bbd-fb78-4562-8279-1f38f9bacddf'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "cinder-quobyte-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:44 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.691s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f1889d-c85f-488f-9f12-50c2dadcccd9]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:44 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Deleted volume successfully. Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-3e50a241-ba3e-45b0-87c1-2b76eae9084b tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-8e40d79f-ecc1-47bc-902a-9f6818aea937-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:44 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:44 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:44 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 Apr 29 16:57:44 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:44 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190" returned: 0 in 0.710s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'} {{(pid=84201) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14b32cd-12f0-405a-b5a6-1d0e729b9f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4177a2f7-9597-4c2c-b06d-fab0ca932190', 'volume_size': 1}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:44 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f25f9d-c435-45a8-9ad0-f659b81b74b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:44 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Volume volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 (4177a2f7-9597-4c2c-b06d-fab0ca932190): created successfully Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f25f9d-c435-45a8-9ad0-f659b81b74b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Flow 'volume_create_manager' (290c7c2b-300b-4a26-8e93-fb0636a4b483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:45 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-8a75e623-9ba9-41bc-88c0-e46e6f8aadeb tempest-SnapshotDependencyTests-9592995 None] Created volume successfully. Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-3404b7bc-4942-4313-84e0-ced56cad0ce3-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-3404b7bc-4942-4313-84e0-ced56cad0ce3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-quobyte-3404b7bc-4942-4313-84e0-ced56cad0ce3" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-3404b7bc-4942-4313-84e0-ced56cad0ce3" acquired by "delete_volume" :: waited 0.022s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86737be-4e0c-4356-a130-0eab60e3f2c5]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:45 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.645s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:45 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Deleted volume successfully. Apr 29 16:57:45 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" returned: 0 in 0.735s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-10262321-44e6-45c9-9dcd-a25ce72afaa4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-5ed9e595-f8cd-48ae-863c-b5dc21c16098-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:45 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0 Apr 29 16:57:45 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:45 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 Apr 29 16:57:45 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Creating offline snapshot 21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 of volume 4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[36727261-b880-4df4-b2ea-beea1cbb80b6]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:45 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 Apr 29 16:57:45 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:45 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" returned: 0 in 0.615s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:45 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-quobyte-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0" released by "delete_volume" :: held 1.415s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Created reservations ['9acc7936-78fa-4489-8670-8f8be01150d4', 'e45c69aa-9933-4fc5-b22e-da2cec1fdc06', '084107b1-bab6-4a5f-8573-ba3b48558b17', 'b3211ee6-3293-4a79-a6dc-e65df8b92a7d'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:46 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3" returned: 0 in 0.827s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:46 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:46 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:46 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3 Apr 29 16:57:46 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:46 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190" returned: 0 in 0.755s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 1G {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:46 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 1G Apr 29 16:57:46 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:46 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.595s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:46 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Deleted volume successfully. Apr 29 16:57:46 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-3404b7bc-4942-4313-84e0-ced56cad0ce3" returned: 0 in 0.604s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-3404b7bc-4942-4313-84e0-ced56cad0ce3" released by "delete_volume" :: held 1.492s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f361028c-344f-42f4-b172-8b3b0256558d tempest-VolumeDependencyTests-1993145891 None] Lock "cinder-612ffe97-c7c2-4cad-8ff0-b3d8a89d78c0-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created reservations ['4d4e8473-db84-4701-af10-f39e1f33e44c', 'ccbbfa47-9768-4f5a-b869-8269e9cb03ce', '98aae217-e257-4d0f-8b3f-ab87f873abc4', '0ef9ff7b-697d-4467-80d4-93ca728e5bb4'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:46 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:46 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:46 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:47 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 1G" returned: 0 in 0.935s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:47 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 Apr 29 16:57:47 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-quobyte-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:47 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.747s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a33aac8-fe99-4725-addd-67eaae9b1308]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:47 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Deleted volume successfully. Apr 29 16:57:47 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f61e7b72-e773-4106-82e5-f6ac2cb42570 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-3404b7bc-4942-4313-84e0-ced56cad0ce3-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:47 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 Apr 29 16:57:47 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:48 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 -F qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140" returned: 0 in 0.880s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:48 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 is being set with open permissions: ugo+rw Apr 29 16:57:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:48 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 Apr 29 16:57:48 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:48 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1" returned: 0 in 0.777s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:48 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1 Apr 29 16:57:48 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:48 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140" returned: 0 in 0.598s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:48 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.info Apr 29 16:57:48 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:48 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:48 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1" returned: 0 in 0.615s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1" released by "delete_volume" :: held 1.460s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created reservations ['08e0cf43-876b-40e4-b7ee-383a3abf622d', '95b8d439-1c06-4e97-bef5-000ee9da566f', 'b0c9fd6b-5b3b-4c32-93e4-fe73743d718e', '97049de0-6380-47c4-ae50-04b07b5bd248'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:49 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:49 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:49 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.info" returned: 0 in 0.592s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:49 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.info is being set with open permissions: ugo+rw Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.info {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:49 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.info Apr 29 16:57:49 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:49 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.616s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-1f9cc794-4487-4cf6-91e7-9a2563698372-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:49 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Deleted volume successfully. Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-1f9cc794-4487-4cf6-91e7-9a2563698372-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f7338a4b-ff04-470e-8da3-1961410092f4 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-4f2ab4ef-6770-4c85-8b54-d29f8ea6edf1-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-quobyte-1f9cc794-4487-4cf6-91e7-9a2563698372" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-1f9cc794-4487-4cf6-91e7-9a2563698372" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4774c010-79d0-4ee3-a95b-a2bcb6c72610]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:49 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:50 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372 Apr 29 16:57:50 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:50 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.info" returned: 0 in 0.620s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.479s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:50 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-3be59b42-84fe-40bb-a78e-a1bb7b595c91 tempest-SnapshotDependencyTests-9592995 None] Create snapshot completed successfully Apr 29 16:57:50 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372" returned: 0 in 0.720s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:50 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:50 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372 Apr 29 16:57:50 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:51 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-1f9cc794-4487-4cf6-91e7-9a2563698372" returned: 0 in 0.585s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-1f9cc794-4487-4cf6-91e7-9a2563698372" released by "delete_volume" :: held 1.351s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created reservations ['3367aa66-968c-41a8-a873-14d2c2d1ef88', 'b420f3e8-8444-447d-865c-e099f3470fc0', '28ea197f-751f-414d-91db-76669a1f2efa', '3c0d6e54-39ff-436e-a52f-8ec663852182'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:51 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:51 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84201) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Flow 'volume_create_manager' (bd284d22-0e4b-44af-8c0a-8047095cd60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab108ff-7eb4-4b03-97b0-bcafa4a74085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab108ff-7eb4-4b03-97b0-bcafa4a74085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc81b9e-ae30-4e14-92d5-36386574f52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5d58882b2d4cdd8e01d212a4032fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:57:51Z,use_quota=True,user_id='c7aa52b169e145cabc2b72a45ebcf812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3faca1-51ac-419a-a40e-01475466f206),volume_type_id=fd3faca1-51ac-419a-a40e-01475466f206)' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f696cbdb-6096-4849-be54-1d8bce7fdfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f696cbdb-6096-4849-be54-1d8bce7fdfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deab6f2-fffd-4d64-9466-be10d4666cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deab6f2-fffd-4d64-9466-be10d4666cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0fc81b9e-ae30-4e14-92d5-36386574f52e', 'volume_name': 'volume-0fc81b9e-ae30-4e14-92d5-36386574f52e', 'volume_size': 1, 'snapshot_id': '21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f390ccb5-d197-40cc-aeac-875b4b5b2ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f390ccb5-d197-40cc-aeac-875b4b5b2ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2535aad1-1b7d-4f2e-a45d-ee6b416432bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:51 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Volume 0fc81b9e-ae30-4e14-92d5-36386574f52e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0fc81b9e-ae30-4e14-92d5-36386574f52e', 'volume_size': 1, 'snapshot_id': '21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140'} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "cinder-quobyte-21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140-0fc81b9e-ae30-4e14-92d5-36386574f52e" by "_create_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140-0fc81b9e-ae30-4e14-92d5-36386574f52e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Creating volume 0fc81b9e-ae30-4e14-92d5-36386574f52e from snapshot 21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 {{(pid=84201) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Selected osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53 as target Quobyte volume. {{(pid=84201) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "cinder-quobyte-0fc81b9e-ae30-4e14-92d5-36386574f52e" by "_copy_volume_from_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-0fc81b9e-ae30-4e14-92d5-36386574f52e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] snapshot: 21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140, volume: 0fc81b9e-ae30-4e14-92d5-36386574f52e, {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6293c2-954a-4262-8b8a-1c3bb692ef45]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:51 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 Apr 29 16:57:51 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:51 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.617s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:51 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:51 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Deleted volume successfully. Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-f0c1410f-5018-455c-a1f7-3eb1731a3827 tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-1f9cc794-4487-4cf6-91e7-9a2563698372-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-24ef403f-a118-44c6-a0da-1202894a77dc-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-24ef403f-a118-44c6-a0da-1202894a77dc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-quobyte-24ef403f-a118-44c6-a0da-1202894a77dc" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-24ef403f-a118-44c6-a0da-1202894a77dc" acquired by "delete_volume" :: waited 0.023s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93dca8c-8e72-42a4-a2ab-f6a1d763a42f]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:52 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc Apr 29 16:57:52 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:52 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140" returned: 0 in 0.710s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4177a2f7-9597-4c2c-b06d-fab0ca932190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Creating direct copy from snapshot {{(pid=84201) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[602417b1-84df-4227-bef7-5f584a8879b0]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:52 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 Apr 29 16:57:52 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:52 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc" returned: 0 in 0.732s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:52 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:52 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc Apr 29 16:57:52 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:53 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190" returned: 0 in 0.709s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG cinder.utils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Path /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e not found in is_blk_device check {{(pid=84201) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:53 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e Apr 29 16:57:53 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:53 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-24ef403f-a118-44c6-a0da-1202894a77dc" returned: 0 in 0.641s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-24ef403f-a118-44c6-a0da-1202894a77dc" released by "delete_volume" :: held 1.417s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created reservations ['824ee460-e10c-4960-8805-2808cec5c770', '463c8bcf-dad4-4e6c-bf45-635da5220b83', 'deab4dd3-3c90-48da-94af-2520c6e67e3e', 'fdf9825b-3f88-4763-a80f-31171fc415b0'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:53 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:53 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:53 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-c8bb92f8-b2a2-4087-be34-4582b14e35ac-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-c8bb92f8-b2a2-4087-be34-4582b14e35ac-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "cinder-quobyte-c8bb92f8-b2a2-4087-be34-4582b14e35ac" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:57:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-c8bb92f8-b2a2-4087-be34-4582b14e35ac" acquired by "delete_volume" :: waited 0.052s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:57:54 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.998s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:54 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:54 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Deleted volume successfully. Apr 29 16:57:54 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c0c791-cc76-4024-8662-a6a280384482]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:54 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:54 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-e669ce6d-c4cc-4654-944e-7c3e858445ca tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-24ef403f-a118-44c6-a0da-1202894a77dc-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:54 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac Apr 29 16:57:54 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:56 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac" returned: 0 in 1.376s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:56 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:56 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac Apr 29 16:57:56 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:57 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-c8bb92f8-b2a2-4087-be34-4582b14e35ac" returned: 0 in 1.164s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:57 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-quobyte-c8bb92f8-b2a2-4087-be34-4582b14e35ac" released by "delete_volume" :: held 2.660s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:57 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Created reservations ['733e126f-c7c3-4534-ac0e-58eacc75e829', 'b476c6de-3012-4d02-a2eb-861094cd705c', 'dcfc263b-4f41-4cda-a9e5-2a7140dcc7c4', '49665552-f5d7-41b0-9127-521b3eaa1098'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:57:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:57:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:57:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:57:57 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:57:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:57 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:57 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:57:57 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:58 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e" returned: 0 in 5.048s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:58 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[257cb74d-a443-4f4a-abe3-9df6c2c6706c]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:57:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:58 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 Apr 29 16:57:58 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:58 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:58 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.821s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:58 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:57:58 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Deleted volume successfully. Apr 29 16:57:58 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-5318dab6-f4c7-4ef7-a472-d15e8933f00b tempest-CreateVolumesFromSourceVolumeTest-1349211966 None] Lock "cinder-c8bb92f8-b2a2-4087-be34-4582b14e35ac-delete_volume" released by "delete_volume" :: held 3.917s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:59 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190" returned: 0 in 0.979s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG cinder.image.image_utils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e {{(pid=84201) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:57:59 devstack cinder-volume[84201]: INFO cinder.image.image_utils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Converted 1024.00 MB image at 202.72 MB/s Apr 29 16:57:59 devstack cinder-volume[84201]: WARNING cinder.volume.drivers.remotefs [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e is being set with open permissions: ugo+rw Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:57:59 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e Apr 29 16:57:59 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:57:59 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e" returned: 0 in 0.603s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-0fc81b9e-ae30-4e14-92d5-36386574f52e" released by "_copy_volume_from_snapshot" :: held 8.148s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140-0fc81b9e-ae30-4e14-92d5-36386574f52e" released by "_create_volume_from_snapshot" :: held 8.179s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.197s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2535aad1-1b7d-4f2e-a45d-ee6b416432bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc81b9e-ae30-4e14-92d5-36386574f52e', 'volume_size': 1, 'snapshot_id': '21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140'}' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7886e6-870b-46eb-b690-6ef70737d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:57:59 devstack cinder-volume[84201]: INFO cinder.volume.flows.manager.create_volume [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Volume volume-0fc81b9e-ae30-4e14-92d5-36386574f52e (0fc81b9e-ae30-4e14-92d5-36386574f52e): created successfully Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7886e6-870b-46eb-b690-6ef70737d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84201) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:57:59 devstack cinder-volume[84201]: DEBUG cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Flow 'volume_create_manager' (bd284d22-0e4b-44af-8c0a-8047095cd60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84201) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:57:59 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-2b89973c-6885-442d-a0c8-c1a71be606b7 tempest-SnapshotDependencyTests-9592995 None] Created volume successfully. Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "cinder-21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140-delete_snapshot" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "cinder-quobyte-4177a2f7-9597-4c2c-b06d-fab0ca932190" by "delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-4177a2f7-9597-4c2c-b06d-fab0ca932190" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "cinder-quobyte-21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140" by "_delete_snapshot" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Deleting offline snapshot 21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 of volume 4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] snapshot_file for this snap is: volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 {{(pid=84201) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ccf784-5e1a-4b75-a15d-c9077f9316c1]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:58:00 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:00 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 Apr 29 16:58:00 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:01 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140" returned: 0 in 0.665s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:01 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.remotefs [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4177a2f7-9597-4c2c-b06d-fab0ca932190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84201) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:58:01 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a67d963-c41d-4959-88f0-52e091c235ac]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:58:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:01 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 Apr 29 16:58:01 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:01 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190" returned: 0 in 0.670s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:01 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:01 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 Apr 29 16:58:01 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:02 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140" returned: 0 in 0.659s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:02 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140 Apr 29 16:58:02 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:02 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:02 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190.21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140" returned: 0 in 0.586s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140" released by "_delete_snapshot" :: held 2.671s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-4177a2f7-9597-4c2c-b06d-fab0ca932190" released by "delete_snapshot" :: held 2.691s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Created reservations ['c6408afd-c71f-402d-81c0-75f93d1c3fe9', '02da9de4-03a9-417e-8813-6a2d8244bda2', '9c43cbc9-820b-4d13-9a92-f1630fd1a33d', '096269bf-5973-4e72-8f34-4f8de4070fc7'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:58:03 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Delete snapshot completed successfully. Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-b2913b4b-f445-4013-b9de-721cc1e95d24 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-21f5d1a2-8c8f-4cc2-92e5-2d9f4516b140-delete_snapshot" released by "delete_snapshot" :: held 2.810s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "cinder-4177a2f7-9597-4c2c-b06d-fab0ca932190-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-4177a2f7-9597-4c2c-b06d-fab0ca932190-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "cinder-quobyte-4177a2f7-9597-4c2c-b06d-fab0ca932190" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-4177a2f7-9597-4c2c-b06d-fab0ca932190" acquired by "delete_volume" :: waited 0.016s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[693a1eac-229d-4a0c-b0b5-5be5c1f94765]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:58:03 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:03 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 Apr 29 16:58:03 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:04 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190" returned: 0 in 0.694s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:04 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190 Apr 29 16:58:04 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG oslo_service.periodic_task [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:04 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:58:04 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:04 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-4177a2f7-9597-4c2c-b06d-fab0ca932190" returned: 0 in 0.631s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-4177a2f7-9597-4c2c-b06d-fab0ca932190" released by "delete_volume" :: held 1.394s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:58:04 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Created reservations ['9fbeba16-7751-4e1e-b891-4f71719acfa9', '50e85821-4ae8-4117-8ea2-af4244431716', '5dc89e84-d956-4fd9-b154-b3cdf07f923d', 'a70fc965-48a0-4c4d-887a-1a0d7a2d49f6'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:05 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:58:05 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:05 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.602s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-f9708d3c-4d4b-4fcc-bc12-5f49a8de0349 None None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:58:05 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.630s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:58:05 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Deleted volume successfully. Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "cinder-0fc81b9e-ae30-4e14-92d5-36386574f52e-delete_volume" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-d8ce5cf7-31a0-4050-9038-97129473c1cb tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-4177a2f7-9597-4c2c-b06d-fab0ca932190-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-0fc81b9e-ae30-4e14-92d5-36386574f52e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "cinder-quobyte-0fc81b9e-ae30-4e14-92d5-36386574f52e" by "delete_volume" {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-0fc81b9e-ae30-4e14-92d5-36386574f52e" acquired by "delete_volume" :: waited 0.019s {{(pid=84201) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf08853-1e49-424f-a956-507fadf6cf15]: (4, 'qcow2') {{(pid=85117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:58:05 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:05 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e Apr 29 16:58:05 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:06 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e" returned: 0 in 0.683s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:06 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:06 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e Apr 29 16:58:06 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:07 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab/volume-0fc81b9e-ae30-4e14-92d5-36386574f52e" returned: 0 in 0.595s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-quobyte-0fc81b9e-ae30-4e14-92d5-36386574f52e" released by "delete_volume" :: held 1.318s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG cinder.quota [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Created reservations ['b5a25f13-9ae8-4a32-add1-82003774192a', 'a528f772-b085-4e7b-a990-537987cb5477', 'eb9ecb13-5ed4-4fe9-8204-3231bc529db7', '53f2cb1c-374f-4894-960d-410a6cf74899'] {{(pid=84201) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53': None} {{(pid=84201) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG cinder.volume.drivers.quobyte [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-89bd9f9a-42f6-4029-add5-1dd4cdc4fd53'] {{(pid=84201) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.lockutils [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84201) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:58:07 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab Apr 29 16:58:07 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:58:07 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG oslo_concurrency.processutils [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b5fb727e7e40cde6ec9fde1614ddab" returned: 0 in 0.588s {{(pid=84201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG cinder.manager [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Notifying Schedulers of capabilities ... {{(pid=84201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:58:07 devstack cinder-volume[84201]: INFO cinder.volume.manager [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Deleted volume successfully. Apr 29 16:58:07 devstack cinder-volume[84201]: DEBUG cinder.coordination [None req-20974c3e-ffaf-476e-b6a8-fc9c9d7bf6d6 tempest-SnapshotDependencyTests-9592995 None] Lock "cinder-0fc81b9e-ae30-4e14-92d5-36386574f52e-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=84201) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:58:17 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:DELETE=9,cinder:SELECT=84,cinder:INSERT=37,cinder:UPDATE=139 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:58:17 devstack cinder-volume[84201]: DEBUG dbcounter [-] [84201] Writing DB stats cinder:DELETE=13,cinder:INSERT=34,cinder:SELECT=103,cinder:UPDATE=140 {{(pid=84201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}